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A18STRACT 

This document reports on a project with the following 
aims: (1) to identify and discuss the important issues about using 
curriculum materials in bilingual-bicultural education and 
multicultural education through a comparative analysis of these 
conditions in the United States and Australia; (2) to identify and 
analyze relevant research in the idexes of the Educational Resources 
Information Center, the Australian Education Index, and the British 
Education Index; (3) to review the activities of three 
institutions — the Social Science Education Consortiiun, the 
Educational Products Information Exchange Institute, and the Centre 
for Educational Technology at the University of Sussex — involved in 
the selection and the evaluation of curriculum materials, with 
particular reference to the characteristics of their programs for 
teacher education; (4) to present a description for an inservice 
teacher education program that aims to develop the knowledge and 
skills of teachers in selecting and evaluating curriculiun materials 
for bilingual-bicultural education and multicultural education; (5) 
to present alternative models and approaches to implement the 
inservice teacher education program; and (6) to conclude with a 
commentary on introducing to Australian education the techniques for 
both selecting and evaluating curriculum materials and implementing 
teacher education programs. A bibliography, author index, and nine 
appendices are included. (Among the appendices are a list of the 
organizations forming the national network of bilingual education, 
five bibliographies from specific educational indexes, and materials 
pertaining to a survey on the need for a course designed to improve 
the quality of selection and evaluation of curriculum materials • ) 
(Author/JD) 
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1. INTRODUCTION 



Evidence derived from practices in bilingual-bicultural and multicultural 
education in North America and, more recently, Australia suggests that the 
quality of curriculum materials is critical in determining the success or 
failure of such educational programs. This reality is exacerbated by 
particular problems posed for educators in the selection and evaluation 
of curriculum materials used in bilingual-bicultural and multicultural 
education. Despite such apparent concerns among educators, their failure 
to respond by improving the quality of selection and evaluation of curriculum 
materials for bilingual-bicultural and multicultural education is partly 
a consequence of inadequate preservice and inservice teacher education. 

The purpose of this paper is to address the problem of improving the 
selection and evaluation of curriculum materials for these programs. 
TFais will be tackled by conducting a review to identify the current 
literature in this field; reviewing the activities of institutions 
involved in the selection and evaluation of curriculum materials, with 
particular reference to their provision of programs for teacher education; 
presenting, as a case study, a proposal for a program in inservice teacher 
education to develop knowledge and skills of teachers in the selection 
and evaluation of curriculum materials for bilingual-bicultural and 
multicultural education that are appropriate to Australian conditions; 
and presenting three alternative models for implementing this proposal. 

Initially, however, it will be helpful to analyse in greater depth the 
important issues involving the selection and evaluation of curriculum 
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materials for bilingual-bicuUural and multicultural education. This 

will be approached through a comparative treatment of the current situations 

in the United States of America and Australia. 

1,1 Problems about Quality, Selection and Evaluation of Curriculum Materials 

Textbook adoption procedures have been enacted by all states of the United 
States. Four distinguishable types of procedure have been adopted for 
textbook selection, varying from a centralised model based upon a state 
selection committee to a decentralised model within local school districts. 
In the centralised model, used by twenty-two states, state selection 
committees, varying from six to thirty members each, use criteria developed 
at the state level to select textbooks for their respective states. In 
the decentralised model, school districts in twenty-eight states develop 
their own criteria, v/hich are then used by local selection committees to 
screen instructional materials. In the third model, school districts in 
one state select textbooks for secondary level and use lists compiled by 
the state board of education to select materials at the primary level. 
In the fourth model , school districts in three states use lists compiled 
by state boards of education to select all instructional materials, 
although one of these states, California, is presently transferring to the 
centralised model (Blaunstein, 1983; Duke, 1985). 

The extent to which those states, practising a centralised form of selection 
have formalised its features, are of greatest significance for moves towards 
improving practices of selection and evaluation of curriculum materials. 

.... 3 



10 



After completing an extensive comparative survey of state selection 
committees in each of these twenty- two states, Duke found considerable 
variety in their application of procedures for selecting curriculum 
material s. 

Reflecting cross-sections of both educational and lay communities, state 
selection committees recommend textbooks to state boards of education for 
listing, in all but two states. The duration of the adoption process 
varies from three months to more than a year among these states. Curriculum 
materials proposed for adoption are usually made publicly accessible 
through materials display centres throughout this period. The procedures 
for adoption also vary widely with some states applying objective criteria 
to evaluate curriculum materials whilst others make subjective decisions 
only. Selection committees also compile annotations of materials adopted 
although only nine of these states extend annotations beyond basic 
purchasing information. 



Duke also surveyed the extent of training for members of selection committees. 

The implication of his findings for the hypothesis presented in this paper 

is immediately apparent when he states that: 

"... ten states provide no training for evaluators in the 
use of such criteria. The remaining twelve states offer 
sessions which range from one to two days. Typically in 
these sessions, which are conducted by the state office of 
education staff, evaluators receive information about the 
responsibilities of a textbook committee member, the 
adoption process - usually the time line - regulations 
about dealings with publishers and their representatives, 
and other legal requirements. In most cases, evaluators 
do not appear to receive training in applying criteria to 
actual sample texts and in almost all cases evaluators do 
not meet again to review materials or to compare findings" 
(11-12). 
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The diversity of textbook adoption policies has influenced responses by 
publishers and different interest groups involved in selection processes. 
States which have adopted centralised policies have consistently attracted 
the interests of large-scale publishers by providing large markets, 
specified criteria related to the technical quality of publication and 
have been influenced by special interest groups. Despite their effect 
upon improving selection procedures, centralised policies in textbook adoption 
have not tended to improve the quality or appropriateness of curriculum 
materials. 
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Klein (1978) identified five major issues concerning the development, 
selection and evaluation of curriculum materials: determining the character- 
istics of quality in curriculum materials; determining the types of research 
methodologies to provide information about curriculum materials; incorporating 
learner-based verification and revision; defining responsibility for learning 
resulting from curriculum materials; and specifying the rights of interest 
groups to determine the materials to be used. Komoski (1980) has referred 
to the failure of schools to assess their learning needs sufficiently to be 
able to match curriculum materials to learners' capabilities and to the 
failure of publishers to provide this information. Additionally, 
Blaunstein identified particular problems concerning the selection processes 
used in adopting curriculum materials. There is a need for education 
departments to provide more resources to update curriculum materials, and 
provide paid release for educators to participate on selection committees. 
The implications of each of these points are briefly discussed below. 

Although criteria applied by selectors and evaluators of curriculum materials 
are based upon a premise that these criteria relate to the quality of 
materials, there is little research available to indicate that such criteria 
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are sufficiently comprehensive for selectors and evaluators to judge the 
intrinsic nature of quality in curriculum materials. Research is necessary 
to determine what makes for curriculum materials of high quality. Criteria 
for judging other materials can then be derived from the results of this 
research. 

A further difficulty is imposed by the limitations of research methodologies 
used to investigate curriculum materials. Generally, experimental designs 
applying a test-teach-retest model have been applied to investigating what 
has been learnt from m^.terials. Although these designs appear to be 
effective in providing answers about materials meant to develop cognitive 
behaviours, it is unlikely that such designs are appropriate for providing 
answers about materials meant to develop affective, psychomotor or a 
combination of behaviours. It is more likely that systematic observation 
and interview techniques rather than experimental designs will provide valid 
answers about how materials affect learners' values and physical performances. 
Furthermore, experimental designs cannot account for all the antecedent 
conditions and contextual variables. that are involved in learning from 
curriculum materials. It is evident that research methodologies to 
investigate various aspects of curriculum materials will need to be extended 
if valid answers are to be provided. 

Learner-based verification and revision of curriculum materials refer to 
procedures for gathering and analysing data obtained from field-testing 
materials with appropriate groups of learners. Providing learner-based 
verification and revision for developing curriculum materials has become 
a particularly controversial issue in American education, largely through 
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efforts by the Educational Products Information Exchange Institute to effect 
legislative enactments in California in 1972 and Florida in 1975. Komoski 
(1975) has identified six guidelines upon which the Educational Products 
Information Exchange Institute nas based implementation of learner-based 
verification in curriculum materials: firstly, for developing, improving 
and maintaining quality and reliability; secondly, for supplying data 
producers' need to provide responsible statements about their products; 
thirdly, for establishing a continuous process that accrues throughout the 
material's life; fourthly, specifying learners as the primary source for 
providing data and that data drawn from secondary sources must relate to 
learner behaviours; fifthly, that learner-based verification should be 
sufficiently detailed to identify strengths and weaknesses of the material; 
and finally, that it is the producers' responsibility to gather and analyse 
such data validly and apply it to improving the effectiveness of their 
products. Such guidelines, however, have not overcome certain intractable 
features of learner-based verification and revision. For instance, limits 
have not been clearly established as to which materials learner-based 
verification and revision should apply to; sampling procedures have not been 
clearly defined; issues relating to the replication of procedures and the 
generalisation of findings have not been solved; and the relationship 
between learner-based verification and revision and quality in curriculum 
materials has not been established by research. 

An additional difficulty is whether the publishers of curriculum materials 
or the teachers who use them are to accept responsibility for the learning 
resulting from the curriculum materials. Publishers have usually been 
criticised for any aspects of bias that might be present in curriculum 
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materials. On the other hand, publishers have sought to shift to 
classroom teachers responsibility for learning resulting from curriculum 
materials. Although shared between publishers and teachers, there is a 
reluctance for this to be accepted by either party. 

The final problem relates to the involvement of different interest groups 
in the selection of curriculum materials. The influences of agencies 
funding curriculum materials to maintain control of the materials* contents, 
the responsibilities of education departments, the activities of professional 
groups and the controversial assertion of rights by community groups to 
censor certain materials, have collectively tended to widen the numbers and 
composition of groups involved in the process of selection. 

1.2 Factors determining the Quality of BiliRgual-bicultural and 
Multicultural Materials 

1.2.1 The Nature of Key Issues 

The selectors and evaluators of curriculum materials for bilingual- 
bicultural and multicultural education have looked at several obtrusive 
problems related to such materials. Tfliese problems concern the linguistic 
content and language level of bilingual materials, and the cultural 
relevance and biases in bicultural and multicultural materials. 

These problems are consistent with three forms of bias identified by 
Mackey (1977): linguistic, cultural and socio-economic. Linguistic 
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bias arises when the standard language of a colonial or immigrant group 
is at lexical variance to the standard language of the homeland. Such 
linguistic bias in bilingual materials is inappropiate in bilingual- 
bicultural programs for immigrant groups, when su:h materials have been 
adopted without adaptation or in a translated form from the homeland or 
another immigrant context of a linguistically identical group. Example 
of linguistic bias are the use of a regional dialect; of culturally- 
charged language that has no equivalent meaning in the same language 
spoken by another immigrant group; and of language unacceptable in its 
standards of grammar, syntax and morphology. Within bi cultural and 
multicultural materials, biases depicting cultural groups through 
stereotypes will reflect the culture of the homeland or a linguistically 
identical group from another- location to the extent that such features 
cannot be readily recognised by immigrants. The issue of cultural 
biases in curriculum materials has attracted considerable attention in 
the United States and Ca i during the past two decades. 

1.2.2 Literary Tireatment discussing the Use of Curriculum Materials in 
Bilingual-bicul tural and Multicultural Education 

It can be seen that scholars writing in the fields of bilingualism and 
bilingijal-bicul tural education, multicul turalism and multicultural 
education have recognised for some time that the quality of curriculum 
materials affects the success of educational programs in these areas. 
The following discussion will provide a comparative treatment of 
preparation, selection and evaluation of curriculum materials for 
bilingual-bicul tural and multicultural programs in the United States 
and Australia. 
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1.2.2.1 The United States of America 



The recent developments occurring in bilingual-bicultural and multicultural 
education in the United States have been mutually complementary. A recent 
review by Ambert and Melendez (1985) supports previous authoritative 
accounts by Cordasco (1976), Andersson and Boyer (1978) and Saville and 
Troike (1978). Ambert and Melendez indicate that eleven states have 
passed laws mandating bilingual education and nineteen states have passed 
legislation permitting bilingual education during the period since 
enactment of the Bilingual Education Act (Title VII of the Elementary and 
Secondary Education Act) in 1968. 

The provision of bilingual-bicul tural programs generally reflects the 
distribution of immigrant groups in the United States. However, Spanish- 
Americans, particularly Chicanos (Mexican-Americans) have received a more 
favourable allocation of bilingual-bicul tural programs than other ethnic 
groups. The annually updated survey of bilingual-bicul tural programs 
(Dissemination and Assessment Center for Bilingual Bicultural Education, 
1975) indicated a total of 320 programs operated in forty-one states and 
territories. The majority of these programs have been directed towards 
Spanish-speaking Chicanos in the southwestern states, Spanish-speaking 
Puerto Ricans in the northeastern states, and native Americans (Amerindians) 

The number of American schools offering programs in cross-cultural 
education is extensive but these schools have developed different 
educational practices to express particular philosophical perspectives 
(Gibson, 1976). Banks (1981) identifies three types of cross-cultural 
education. These are multicultural education aimed at imparting concepts 
such as prejudice and discrimination in common terms for different cultural 
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groups; multiethnic education which involves modifying school environments 
to provide equal educational opportunities for different ethnic groups; and 
ethnic studies, aimed at the transmission of knowledge about a variety of 
ethnic groups. Because of a lack of conceptual clarification in the use 
of these terms for different types of cross-cultural education, these types 
should not be considered to be mutually exclusive. 

A comprehensive treatment of the development, selection and evaluation of 
curriculum materials for implementation in bilingual-bicultural programs 
in the United States has been provided by Blanco (1977, 1978). This writer 
indicated that initially the quality of bilingual-bicultural materials 
was diminished by hasty preparation on the part of publishers who 
recognised a potentially lucrative market, especially among Spanish-speaking 
groups. The quality of such materials improved, however, once the 
National Network for Bilingual Education was established by means of Title 
VII legislation. This network comprises nine federally sponsored materials 
development centres, which have the purpose of developing instructional, 
teacher-training and testing materials in the languages of the major non- 
English speaking ethnic groups and at the grade levels of particular 
bilingual target groups; seven resource centres which train school personnel 
in the use of bilingual-bicultural materials and provide facilities for 
field-testing materials developed by the materials development centres; 
and two dissemination and assessment centres, which identify, edit, 
reproduce, review and distribute bilingual-bicultural materials. The 
characteristics of this network are listed in Appendix 1. 

Additionally, several of the nine research and development centres establishe 
by the United States Office of Education under the Research and Development 
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Centers Program (1963) and the eight regional educational laboratories 
established under United States Office of Education guidelines during 
1955 and 1956, have been involved in the development of curriculum materials 
for bi lingual -bicul ?,ural and multicultural education. Examples of 
significant initiatives by research and development centres and regional 
educational laboratories have been those of The Center for the Study of 
Evaluation, University of California at Los Angeles, to develop the 
Sy^tm {^oK Objza^tivQjy-ha^zd Evalua^on 0(J RzacUng - Spayiuh^ a criterion- 
referenced instrument to assist teachers in selecting and cataloguing 
objectives for assessing students' needs; and the Southwest Educational 
Development Laboratory, Austin, Texas, to develop a variety of bilingual 
Spanish-English curriculum materials. 

Current activities to develop, select and evaluate curriculum materials 
for multicultural education, multiethnic education and ethnic studies 
have not been as extensive or comprehensive as activities indicated for 
bil ingual-bicul tural education. Responsibilities for these activities 
have been largely given to state education departments and local school 
districts although the Social Science Education Consortium, Boulder, 
Colorado, has assisted by identifying, editing, reproducing, reviewing 
and disseminating curriculum materials as part of responsibilities under 
the Ethnic Heritage Studies Program. 

One can see that despite the autonomy of states to determine educational 
policies, the American situation is characterised by federal legislative 
intervention through the Elementary and Secondary Education Act to establish 
nationally, the Bilingual Education Programs (Title VII) and the Ethnic 
Heritage Studies Programs (Title IX). Federal intervention within the 
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Bilingual Education Programs has been most extensive, leading to the 
establishment of a network of institutions to facilitate development and 
dissemination of bil ingual-bicul tural curriculum materials. The federal 
government has also funded projects to develop bil ingual-bicultural 
curriculum materials through several of the regional educational laboratories. 
These projects have been intended to support bilingual programs offered by 
education service centres and school districts. Although federal 
intervention within the Ethnic Heritage Studies r-rograms hc^s not been as 
obtrusive as. within the Bilingual Education Programs, funding of projects 
to develop multicultural curriculcjrri materials has been provided to a 
multiplicity of institutions: regional educational laboratories; education 
service centres; and school districts. Despite limitations of the 
national policies enacted in the Bilingual Education Programs and Ethnic 
Heritage Studies Programs, it cannot be denied that these national policies 
have been successfully implemented. This situation contrasts with 
comparative developments in Australia where the major effort has been 
placed upon developing and implementing curriculum materials for multicultural 
education programs whilst similar initiatives for bil ingual-bicul tural 
education have been neglected. 

1.2.2.2 Australia 

The niasons for developing bilingual-bicultural and multicultural education 
in Australia have been similar to those given for the United States of 
America, although Australian developments have not been accompanied by the 
same degree of legislative action. Instead, initiatives have usually 
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occurred in response to governmental inquiries and subsequent reports. 
These governmental inquiries and reports are briefly discussed below. 

TPie first significant inquiries and reports, the Departrnent of Education 
(1975) and jepartment of Education (1976), stressed the need to implement 
programs for second languages and multicultural education that were appropriate 
to the needs of both migrant and Anglo-Australian groups. In response 
to the Commonwealth Schools Commission (1975), funding of multicultural 
education through the Child Migrant Education Program commenced in 1976. 
The Review of Post-Arrival Programs and Services to Migrants (1978) 
recommended the establishment of a committee, the federally sponsored 
Committee on Multicultural Education, to advise the Commonwealth 
Schools Commission upon the distribution of funds to the Multicultural 
Education Program through state multicultural education co-ordinating 
committees. This structure is likely to alter, becoming the Australian 
Community Languages and Culture Program, as forecast by the Commonwealth 
Schools Commission (1985). It is proposed that the Australian Cormnunity 
Languages and Culture Program will incorporate the Multicultural Education 
Program and the insertion class element of the Ethnic Schools Program, 
and place greater emphasis upon bil ingual-bicul tural education. 

The Australian Institute of Multicultural Affairs (1980; 1982) reports 
that there have been few initiatives in bil ingual-bicul tural education 
in Australia. Programs have been restricted to aboriginal Australians 
in the Northern Territory (Northern Territory Department of Education, 
1985), Italians in South Australia, Greeks (Zangalis, 1980) and Italians 
in Victoria, and Vietnamese and Italians in Western Australia. Community 
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language programs which include both second language studies, of a less 
demanding nature than bilingual education, and cultural contents, are 
common in Australia. TRese programs are intended for children of both 
non-English speaking and Anglo-Australian backgrounds. In Australia,- 
multicultural education has concentrated upon imparting concepts and values, 
and transmitting knowledge about migration and ethnic studies. There 
have been few efforts to establish multiethnic education in Australia. 

The limited extent of implementation of bilingual-bicultural programs in 
Australia has affected and restricted the development of curriculum materials 
for such programs. TRe major responsibility for developing curriculum 
materials within the Multicultural Education Program has been undertaken- by 
the Curriculum Development Centre. The Australian Institute of Multicultural 
Affairs (1980) has critised the role of preparing materials performed by the 
Curriculum Development Centre, indicating that most of the small production 
of bilingual-bicultural materials has occurred in conjunction with state 
departments of education. TRe production of curriculum materials by the 
Curriculum Development Centre has supplemented the Language Teaching Branch 
of the federal Department of Education's production of English-as-a-second- 
language materials within the Child Migrant Education Program. Because of 
limited co-ordination in the past between these two bodies and their failure 
to respond to local needs, the Commonwealth Schools Commission (1985) has 
indicated that greater emphasis will in future be placed upon co-operative 
development of bilingual-bicultural materials on a decentralised basis. 
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1.2.3 Conclusion 



The preceding discussion indicates that several important factors - the 
characteristics of textbook adoption procedures, the characteristics of 
quality in curriculum materials, the types of research methodologies 
providing information about curriculum materials, the application of learner- 
based verification and revision to curriculum materials, definition of 
responsibility for learning resulting from curriculum materials, and 
specification of the rights of interest groups to determine the materials 
to be used - have influenced practices in the selection and evaluation of 
curriculum materials. The discussion also identified that problems 
within these factors, which are proving particularly resistant to solution, 
are presently constraining improvement in the quality of the selection and 
the evaluation of curriculum materials. It can be concluded that the 
natures of these factors are particularly significant in fashioning the 
forms of curriculum development and implementation of any teacher education 
program to improve the quality of both the selection and the evaluation of 
curriculum materials. 

The discussion about specific flaws in curriculum materials for bilingual- 
bicultural and multicultural education, such as biases, suggested that 
attention to the selection and the evaluation of materials in these fields 
is imperative. The comparative study of activities in the United States of 
America and Australia indicated that serious attention has only been given 
by educational authorities in the United States to providing facilities and 
training of personnel for the selection and the evaluation of curriculum 
materials for bilingual-bicul tural and multicultural education. 
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2. SELECTION AND EVALUATION OF CURRICULUM MATERIALS: AN ANALYSIS OF 
THE LITERATURE 



The author conducted a review of research through a systematic search of 
several of the information systems related to education. These were the 
Rz60LJUic^6 Iyi Educcution and the CtxAA^nt I^idex to JouAnaLs In EduccutLon 
databases, compiled by the Educational Resources Information Center, 
Washington, D.C., the BhAJU^k Educcution I^idex, compiled by the British 
Library Bibliographic Services Division, and the Au^t/uiLian Educcution 
Index, compiled by The Australian Council for Educational Research, 
Hawthorn, Victoria, Australia. 



Annotations of research, stored in these computerised information retrieval 
systems, consist of two forms: firstly, current research findings, project 
and technical reports', speeches, unpublished manuscripts and books =, which, 
with a few exceptions entered in the ka^tAjoJUjoin Educcution iFidex, are 
restricted to the R^^ouAceJ> In Educcution database; and secondly, journal 
articles compiled in the CunAznt Indtx. to JouAnaLs tn Educcution database, 
the BHAjti^h Educcution Indzx and the Au^tAoLian Educcution Jndzx. These 
two forms of research are listed separately in the appendices, and the 
discussions of the results of each part of the search, are treated 
independently. 

The purpose of the search was threefold: to identify and document 
activities occurring within the field of interest; to survey the extent 
of activities within the field; and, most importantly, to draw upon these 
activities to extend the scope of research conducted in this project. 



The search was directed toward identifying three types of research 
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relevant to the topic: general developments in the selection and 
evaluation of curriculum materials that do not specifically relate to 
particular subject areas; general developments that relate to teacher 
education in the selection and evaluation of curriculum materials; and 
developments in the selection and evaluation of curriculum materials for 
bilingual-bicultural education, multicultural education and related 
areas. Research that related to the evaluation of bias in curriculum 
materials has been included in the latter section. Since both bilingual - 
bicultural education and multicultural education have been frequently 
implemented through an integrated approach across subject areas of the 
curriculum, specific limits were not placed upon restricting the search 
to particular subject areas. The criterion applied to selecting research 
for inclusion in the appendices, was that the research was judged to 
relate to bil ingual -bicul tural education or multicultural education. 

2.1 Non- journal Works 

2.1.1 Rq^oivlcq^ Educcutton 

2.1.1.1 The Procedures 

The search through the annotated index in the Rqaouacqa ^yi Educcution 
database, was conducted manually and included the period between the 
establishment of the database in November 1966 and December 1985. 
A total of 158 documents indexed in the RoAou/iaeJi In EduaatZon database 
were identified and are listed in Appendix 2. The documents are listed 
alphabetically by author, followed by the publication date, document 
title, publishing location, publisher, and the E.R.I.C. accession 
number. 
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The manual search was conducted through the Subject Index using the 
following descriptors: bilingual education; instructional materials; 
multicultural education; multicultural textbooks; reading material 
selection; textbook bias; textbook evaluation; and textbook selection. 
Initially, identification was made on the basis of the relevance of 
each document's title, and then, in each case, recourse was taken to 
examining relevant abstracts indexed in the Main Entry section. It 
was possible to accept or reject each document for inclusion in Appendix 
2 on the basis of the description provided in the abstract satisfying 
a specific criterion. This criterion specified that the document 
included subject matter that related substantially to the selection and 
evaluation of curriculum materials, including the evaluation of bias. 
The documents identified and selected, were then classified for indexing 
in Appendix 2 according to the three types of research previously 
described. 



2.1.1.2 The Results 



Annotations of research about selecting and evaluating curriculum materials 
that have been entered in the Re^ou/ice^ A.n Educcution database, represent 
an infinitesimal proportion of its total entries. The 158 documents 
represent 0.06% of a total of 250,173 documents (ED 010 000 through ED 260 172 
indexed in the R^ouAaU in Educcution database during this period. 
Among the 158 documents, 67 related to research about general developments 
in selecting and evaluating curriculum materials, 10 related to research 
about teacher education in selecting and evaluating curriculum materials, 
and 81 related to research about selecting and evaluating curriculum 
materials for bil ingual-bicul tural education, multicultural education and 
related areas. 
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An examination of the total number of documents for each year of 
publication reveals an increasing trend, peaking in 1976, in the 
absolute number of documents published in the field. Thereafter, 
a decreasing trend in the absolute number of documents published in 
the field is recorded. A similar picture is reflected within the 
two predominant types of research within the field. This information 
is shown in Table 1. 

Table 2 shows the distribution of the sample on the basis of the year 
of indexing in the R2AouA.az6 In Education database, together with the 
total number of entries in this database. A chi-square test was 
performed in order to test whether the distribution of the sample by 
year of indexing was significantly different from the distribution for 
all entries in the Re^ooAce^ In Educcution database. The value of 
chi-square was 25.08 at 17 degrees of freedom. Failing to reach a 
probability of 27.587, this result was not significant at the .05 level. 
A Kolmogorov-Smirnov test for large samples was also performed to test 
the same frequency distributions between the sample and the population. 
Once the largest difference, .08, was obtained, a two-tail test was 
applied, providing a probability for significance of .108 at the .05 
level. Since the largest difference was not equal to, or greater than, 
.108, the result was not significant. Both tests indicated that the 
distribution of the sample was not significantly different from any 
randomly drawn sample from the population of entries in the Re^oo/tce^ 
yin Educcution database. 

One hundred and forty-seven (93.0%) of the contributions in this field 
to the R2AouAc^6 In Educcution database, originated from sources in the 
United States of America. Of the remainder, six documents (3.8%) came 
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Table 1: Documents indexed in E^R.I.C, Re^ouAce^ in EdaccuUony by 
Year of Publication 



Year 


General 




Teacher 
education 


Bil ingual , 
multicultural 


Total 






nos . 


%age 


nos. 


%age 


nos. 


%age 


nos . 


%age 


1963 


1 


0.6 


0 


0.0 


0 


0.0 


1 


0.6 


1964 


0 


0.0 


0 


0.0 


1 


0.6 


1 


0.6 


1965 


0 


0.0 


0 


0.0 


1 


0.6 


1 


0.6 


1966 


0 


0.0 


0 


0.0 


0 


0.0 


0 


0.0 


1967 


1 


0.6 


0 


0.0 


2 


1.3 


3 


1.9 


1968 


2 


1.3 


0 


0.0 


2 


1.3 


4 


2.5 


1969 


4 


2.5 


0 


0.0 


4 


2.5 


8 


5.1 


1970 


4 


2.5 


0 


0.0 ^ 


4 


2.5 


8 


5.1 


1971 


3 


1.9 


0 


0.0 


3 


1.9 


6 


3.8 


1972 


3 


1.9 


0 


0.0 


2 


1.3 


5 


3.2 


1973 


5 


3.2 


0 


0.0 


5 


3.2 


10 


6.3 


1974 


3 


1.9 


1 


0.6 


6 


3.8 


10 


6.3 


1975 


6 


3.8 


2 


1.3 


6 


3.8 


14 


8.9 


1976 


9 


5.7 


0 


0.0 


7 


4.4 


16 ' 


' 10.1 


1977 


2 


1.3 


1 


0.6 


9 


5.7 


12 


7.6 


1978 


5 


3.2 


2 


1.3 


4 


2.5 


11 


7.0 


1979 


1 


0.6 


0 


0.0 


5 


3.2 


6 


3.8 


1980 


3 


1.9 


1 


0.6 


4 


2.5 


8 


5.1 


1981 


4 


2.5 


U 


U.U 


c 
0 


Q 0 

■i . c 


9 


5.7 


1982 


5 


3.2 


1 


0.6 


3 


1.9 


9 


5.7 


1983 


3 


1.9 


0 


0.0 


4 


2.5 


7 


4.4 


1984 


3 


1 9 


1 


0.6 


3 


1.9 


7 


4.4 


1985 


0 


0.0 


0 


0.0 


1 


0.6 


1 


0.6 


n.d. 


0 


0.0 


1 


0.6 


0 


0.0 


1 


0.6 


Total 


67 


42.2 


10 


6.3 


81 


51.3 


158 


100.0 
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Table 2 : Documents indexed in E.R.I.C., Rz^oluicz^ In Educcution^ by 
Year of Indexing 



Year 


General 


Teacher 
education 


Bilingual, Total 
multicultural 




NO. OT K.i.t. 

entries 




nos. 


%age 


nos. 


%age 


nos. 


%age 


nos. 


/oage 




1966 


1 


0.6 


0 


0.0 


0 


0.0 


1 


0.6 


94 


1967 


0 


0.0 


0 


0.0 


3 


1.9 


3 


1.9 


2255 


1968 


1 


0.6 


0 


0.0 


0 


0.0 


1 


0.6 


8803 


1969 


1 


0.6 


0 


0.0 


4 


2.5 


5 


3.?. 


10453 


1970 


6 


3.8 


0 


0.0 


4 


2.5 


10 


6,3 


10456 


1971 


5 


3.2 


0 


0.0 


0 


0.0 


5 


3.2 


12330 


1972 


2 


1.3 


0 


0.0 


2 


1.3 


4 


;l5 


12230 


1973 


2 


1.3 


0 


0.0 


3 


1.9 


5 


3.2 


14167 


1974 


4 


2.5 


2 


1.3 


3 


1.9 


9 


5.7 


14466 


1975 


5 


3.2 


1 


0.6 


5 


3.2 


11 


7.0 


15341 


1976 


5 


3.2 


1 


0.6 


2 


1.3 


8 


5.1 


16819 


1977 


7 


4.4 


• 1 


0.6 


8 


5.1 


16 


10.1 


15271 


1978 


5 


3.2 


0 


0.0 


11 


7.0 


16 


10.1 


15303 


1979 


4 


2.5 


2 


1.3 


5 


3.2 


11 


7.0 


16756 


1980 


1 


0.6 


1 


0.6 


3 


1.9 


5 


3.2 


15993 


1981 


2 


1.3 


0 


0.0 


6 


3.8 


8 


5.1 


14934 


1982 


7 


4.4 


0 


0.0 


6 


3.8 


13 


8.2 


13825 


1983 


1 


0.6 


1 


0.6 


5 


3.2 


7 


4.4 


13627 


1984 


4 


2.5 


0 


0.0 


3 


1.9 


7 


4.4 


14247 


1985 


4 


2.5 


1 


0.6 


8 


5.1 


13 


8.2 


128C3 


Total 


67 


42.4 


10 


6.3 


81 


51.3 


158 


100.0 


250173 
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from Canadian sources, three documents (1.9%) came from Australian 
sources, one document (0.6%) originated in India and one document (0.6%) 
originated in Thailand. 

An analysis of American institutions responsible for contributions to the 
R^6ouAc^^ In EduccuUon database, indicated that such contributions 
originated from a variety of sources. Of the 147 documents, twenty 
documents (13.6%) originated from universities. Of the sixteen universities 
contributing research, three documents originated from the City University 
of New York and two documents originated from The Ohio State University. 
Universities also contributed jointly with other institutions to research 
in the field. Six universities were represented in contributions to 
joint research; two contributions to joint research were made by the 
Northern Illinois University, whilst the remaining universities each 
contributed jointly to single documents. Both academic research and 
higher degree theses were represented in documents contributed by tertiary 
institutions. 

Sixteen documents (10.9%) originated from educational research institutions. 
Of these contributions to the Rz6ouAaeA Eduacution database, four 
documents originated from the Educational Products Information Exchange 
Institute, four came from the Educational Testing Service, and four came 
from the Social Science Education Consortium. 

Thirteen professional bodies were responsible for contributing seventeen 
documents (11.6%) to the Roj^ouacqa Eduacution database. Of these 
contributions, four documents originated from the National Council for the 
Teaching of English and two documents originated from the National 
Education Association. 
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Three documents (2.0?') were contributed to the Rt6ouAct6 in Education 
database by federal education agencies and commissions. Regional 
educational laboratories contributed three documents (2.0%), and 
education service centres contributed seven documents (4.8%). 

Twenty-seven documents (18.4%), the largest quantity, were contributed 
to the RuouAcQ^ in Educcution database by state education departments, 
state education boards and state funded commissions. Education agencies 
from sixteen states were responsible for contributing this group of 
documents. Four documents were contributed by agencies based in Illinois, 
three by agencies based in California, and two each by agencies based in 
Arizona, Indiana, Maryland, New Jersey, Ohio and Pennsylvania. Fifteen 
of these documents were statements of guidelines for selecting and 
evaluating curriculum materials. Two documents (1.4%) were contributed 
by school districts, and two documents were contributed by authorities 
responsible for education projects. 

Papers presented at conferences constituted eighteen documents (12.2%) 
entered into the Rz6ouAaz6 in Education database. Twelve conference" 
organisations were represented among this group, with three documents 
each being contributed by speakers at conferences of the American 
Educational Research Association and the National Council of the Teachers 
of English, and two documents each being contributed by speakers at 
conferences of the Associationr.for Supervision and Curriculum Development 
and the International Reading Association. 

Fourteen documents (9.5%) contributed to the Rqaouacqa in Education 
database, were cooperative works between authors from universities, 
with a state education department and an educational research institution 
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(0.7%), with an educational research institution (0.7%), with a state 
education department (1.4%), with a school district (0.7%), with an E.R.I.C. 
clearinghouse (0.7%),. and with a publisher (0.7%). In other instances, 
professional bodies cooperated jointly (2.0%), also with a state education 
department (0.7%), and with an educational research institution (0.7%). 
Also, a national education agency and a publisher cooperated jointly (0.7%). 

Additionally, E.R.I.C. clearinghouses, associated with other educational 
institutions, were responsible for four documents (2.7%). Furthermore, 
publishers accounted for four documents (2.7%) entered into the Rqaouacqa 
In EduccuUon database. Finally, publishers were not specified for the 
remaining ten documents (6.8%) included in the Re^ouAce^ In EduccuUon 
database. 

2.1.2 AoA^ottan EduccuUon Indzx 

The search through the annotated index of the Au^tAoLlan Education Indzx 
was conducted manually to include the period, January 1970 through to 
December 1985. The procedure adopted to identify relevant documents was 
identical to that adopted for the search conducted in the E.R.I.C. 
databases. The following descriptors were used to complete the search: 
bilingual education; multicultural education; media selection; reading 
material selection;. textbook bias; textbook evaluation; and textbook 
selection. The ten non journal works indexed in the ku^iAatian EduccuUon 
Index are listed alphabetically by author, followed by publication date, 
document title, publishing location, publisher, and accession number when 
this was indicated, in Appendix 5. Statistical analyses of these findings 
were not possible because the accession numbering system was incomplete 
for the period surveyed. 
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2.2 Journal Articles 



2.2.1 CuAAznt Index to JoixmaJU in Educcutlon 



2.2.1.1 The Procedures 

The search through the annotated index of the CuAAunt Index to JouAnal^ in 
Educcution database, was conducted manually to include the period between 
January 1980 and December 1985. The procedure and criteria adopted to 
identify relevant articles were: identical :to. those adopted for the search 
conducted in the Re6oa/Lce>6 m Educatton database. Once selected, 
however, journal articles were classified as either methodologies or 
studies within each of the three types of research. The articles are 
listed in Appendix 3, alphabetically by author, followed by publication 
date, article title. Journal title, volume number, issue number, 
pagination, and E.R.I.C. accession number. 



2.2.1.2 The Results 



Publication of research about selecting and evaluating curriculum materials 
is also poorly represented in journals. A total of 73 articles, indexed 
in the CuAAznt Index to JovJinaJU In Edacatlon database during this period, 
were identified. They represent 0.06% of a total of 115,552 articles 
(EJ 207 485 through to EJ 323 036) indexed in the CuAAtnt Index to JoixAnaJU 
In Educcutlon during this period. Among the 73 articles, 40 related to 
research about general developments in the selection and evaluation of 
curriculum materials, 1 related to research about teacher education in the 
selection and evaluation of curriculum materials, and 32 related to research 
about the selection and evaluation of curriculum materials for bilingual- 
bicultural educatfon, multicultural education and related areas. 
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Articles were contributed to 47 journals (4.5%) of a total of 1044 
journals indexed in the CuiAAznt Jndzx. to loixAnaJU in EducaJxan database 
during this period. An analysis of the study sample of journals and the 
population of journals by country of publication is presented in Table 3. 
On this basis, the study sample of journals represented, as a proportion 
of the population of journals, for the United States (4.6%), for the 
United Kingdom (2.2%), for Canada (8.3%), for Australia (5.0%), for 
France (10.0%), and for Italy (100.0%). 

A chi-square test was performed to test whether the distribution of the 
47 journals in the study sample by country of publication, was significantly 
different from the same distribution for the population of journals 
reviewed for entry into the CuAAznt Indzx. to 3oixAYicUU> in Educcution 
database. Because the number of journals included in the study sample 
published outside the United States was particularly small, two cells, 
in addition to a cell containing the data for the United States, contained, 
in the first case, data from countries seemingly overrepresented in the 
study sample, and in the second case, countries seemingly underrepresented 
in the study sample. The value of chi-square was 6.03 at 2 degrees of 
freedom. Reaching a probability of 5.99, this result was significant at 
the .05 level . 

The chi-square test indicated that the contribution from countries, 
seemingly overrepresented in the study sample, was statistically significan 
when compared to the remaining countries. From this group of countries, 
comprising Canada, France, Italy and Australia, journals published by 
Canadian sources evidently predominated in this group. It could be 
conjectured that the geographical proximity of the Canadian sources to 
American activities in this field, explained the significantly greater 
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Table 3. Journals Indexed in E.R.I.C, CuhAent Index to JouJimJU in EduccuUon, by 
popiilation and Study Sample, January 1980 through to December 1985. 



Country 


Study Sample 


Population 




nos. 


% 


nos. 


% 


A 1 1 c "hi^a 1 T a 
Mub Lra 1 1 a 


1 


? 1 


C.\J 


1 Q 


d6 1 9^ uin 


n 


n n 


0 


n ^ 


Pa na ria 


o 




00 


0.0 


L 1 re 


0 


0 n 


1 
X 


n 1 

U • X 


Fiii 

r 1 J 1 


n 


n n 


1 
1 


n 1 


r 1 11 1 a iiQ 


n 

u 


n n 


1 
1 


n 1 


f> v>a r4 Q 


1 

1 


9 1 


1 n 


n Q 


r^ob^manv/ rTQ/^Q^al DorMimn/^ 

ueriuaiiy* reuerai KcpuDi ic 


n 
u 


n n 


Q 

o 


u.o 


Cha na 
Ui la ria 


n 


0 n 


1 


n 1 

U • X 




n 


n n 


1 


n 1 

U • X 


T nrl 1 a 

JL riu 1 a 


n 


n n 


o 
0 




Iran 


n 


n n 


c 




1 ua r jr 


1 


2 1 


1 

X 


n 1 

U . X 


.lama i pa 
uaiiia 1 t#a 


n 


n n 


1 
1 


n 1 


•la na n 

ua[jaii 


0 


0 0 


2 


n 7 


Mai r) r) 

na 1 ajr o i a 


n 


n n 


1 
1 


n 1 

U . 1 


nc Liier 1 anQ5 


n 


n n 


7 


n 7 
u . / 


li I yci 1 a 


0 


0 n 


1 

X 


n 1 

U • X 


Mni^wa V/ 
iiUi wajr 


0 


0.0 


1 


0.1 


Romania 


0 


0.0 


1 


0.1 


Singapore 


0 


0.0 


1 


0.1 


Spain 


0 


0.0 


2 


0.2 


Switzerland 


0 


0.0 


3 


0.3 


United Kingdom 


2 


4.3 


93 


8.9 


United States 


39 


84.0 


841 


80.6 


TOTAL 


47 


100.0 


1044 


100.0 
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number of Canadian journals publishing articles in this field. On the 
other hand, the contribution from countries, seemingly underrepresented 
in the study sample, was statistically significant when compared to the 
remaining countries. This group comprised the United Kingdom, together 
with the remaining countries (mainly European and developing countries) 
contributing journals to the population but whose journals failed to 
publish articles in this field. It could be conjectured that statisticall 
significant underrepresentation of publication of journal articles in 
this field indicated that sources in these countries were isolated from 
current activities in the field. Although the number of journals from 
American sources publishing articles in this field was proportionally 
greater than the contribution of American journals to the population, the 
American contribution failed to add significantly to the chi-square test. 
Despite publications of articles in American journals contributing to the 
bulk of published research in the field, it could be conjectured that thes€ 
publications were restricted to a small proportion of journals. The 
publications concentrated in these journals were apparently muted by the 
activities of the plethora of journals that characterise the American 
situation. 

Table 4 shows the number of articles identified in each of the 47 journals 
for each year of publication. An examination of the 73 articles showed 
that 62 articles (84.9%) were published in the United States, 5 articles 
(6.8%) were published in Canada, 2 articles (2.7%) each were published in 
Australia and the United Kingdom, and one article (1.4%) each was publishe< 
in France and Italy. Table 5 indicates the number of articles according 
to the year of indexing in the Cu/uidnt Indo^x to JouAnaZ^ in EduccutLon 
database. 



Table 4: Articles indexed in E^R^I.C, Ciwitnt Index to JouAnal^ in EdaccuUon. by Journal 
and Year of Publication. 



1978 1979 1980 1981 1982 1983 1984 1985 TOT 

Academic TkoAMpy. 7 ^ 

AmoAlcan CducatLori 7 ; 

AmGAican Cduccuto/i: Tko. 
^/lof^QA^LorwU. QounncU. 
ihd AmojiLcaa FedQA.aiA.on 

of. Teacheyi^ 11 2 
AmejiLcari School Boojid 

QouMJiaL 1 12 
Atuii/iaZLan Qou/inal of 

Reading, 2 2 

3tuilne^^ SducQytton Fo/ium 7 7 

CatlioJXc LLb/iayiy. Wo/ild 7 7 

CleoAlng. Hou^e 7 ; 

Contempo/ia/iy. Educa^on 7 7 

CanjiLcuAjum l^evLew j j 

D/iex.el Lib/iQAy. Qua/ite/Uy. 1 7 

Education Canada 7 -f 

Education 3-13 • 7 7 
Educationai CormunicaJu^on 

and TecJmoiogy. 11 2 

Edjucationai Leadeji^hip 7 13 5 

Edjuca^Jjonai Technoiogy. 2 13 
Eiemervt^: T/iandiatung, Tkeo/iy. 

into P/iactice 7 7 

6LT ^ou/mai 7 ^ 

EngAJ^h QounruiL 7 7 

Execwtive 6ducat:o/i 7 7 

F/iancaiA daru ie Monde 7 -j 

Q/C/T 1 1 ' 2 

HLdto/iy. & Sociai Science Teackeyi 111 3 

SJJJjxoiy^ Schooi Re^ea/ich and Oeveiopment 1 7 

Jn^t/iucto/i 1 7 

Qounnai of Coiiege Science Teaching, 7 7 

^ouAnat of LeoAning, DLdabUJjtieyi 1 7 

QouAiwui of NegAo Education 11 2 

QouAfiai of Reading, 12 11'^ 5 

Qounnxii of Soci,al Studiz/i Re^eaAch 7 7 

QouAfial of Speci,ai Education Technoiogy, 7 7 
flleo/iUAementi & Evaluation tn CouriAeLLing 

and DeveyLopment 7 7 
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homorvtum 

MBE: Tko, gouAjnal ^o/i 

ihe. NatLoricil A^^odatLori 

^o/i BLUngucU EducatLori ; 

Niui^SQ, Educcuto/i 

9hl Delta Kappon f 
fointo/i -J 
9/ilnoLpal 

"Ra^^egna JtcUlona di 

LiagiiL^tlca AppJJiccvta 7 
Heading, Ho/tl^oiu 
Tieaduig Jrap/iovement 
l\oepeji l\evLew 

Social Studies j 
Teaching CKcepilonal 

Chlldn.en 7 
Technological Ho/tl-goru In 

Education 2 
TennoA^ee Education 

Today.' ^ Educallon 7 



Total NumboMA 



/r/o /y/y /y<3-0' 7ytf7 1^^2 1983 1985 

1 



1 
1 
2 



13 19 12 10 8 



Total fejicenlage i.U 6.8 17. 8 26.0 l6.i^ 13.7 11.0 6.8 
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TablG 5: Articles indexed in E.R.I.C., Cun/Ldnt Index to JoaAnaU In 
EduccuUoyij by Year of Indexing 





General 


Teacher 
education 


Bil ingual , 
mul ti cultural 


Total 


No. of 
entries 




nos . 


%age 


nos. 


%age 


nos. 


%age 


nos. 


%age 




1980 


7 




0 


n n 


U 


O • u 




1 7 8 


21/51 




7 


9.6 


0 


0.0 


6 


8.2 


13 


17.8 


21428 


1982 


11 


15.1 


0 


0.0 


8 


11.0 


19 


26.0 


17213 


1983 


5 


6.8 


1 


1.4 


6 


8.2 


12 


16.4 


18324 


1984 


2 


2.7 


0 


0.0 


2 


2.7 


4 


5.5 


18836 


1985 


8 


11.0 


0 


0.0 


4 


5.5 


12 


16.4 


18000 


Total 


40 


54.8 


1 


1.4 


32 


43.8 


73 


100.0 


115552 
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2.2.2 AiUtAaZian BdaacuUon Inddx 



2.2.2.1 The Procedures 

The search through the kiUtAaLian Bdaca^Lon Index was conducted manually 
to include the period January 1980 through to December 1985. The 
procedures adopted to identify and list relevant articles in the appendix 
were identical to those adopted for the search conducted in the Cu/uiayvt 
Index to JouAncuU in EduccutLon database. The articles are listed in 
Appendix 6, alphabetically by author, followed by publication date, article 
title, journal title, volume number, issue number, pagination, and kvu^tAollay 
EdaccvtLon IndzK volume number and the accession number for the year of entry. 

2.2.2.2 The Results 

Publication of research about selecting and evaluating curriculum materials 
also appears to be poorly represented in journals indexed in the 
Aiutn/xZian EdaacuUon Index. A total of 21 articles, indexed during the 
period covered by the search, were identified. Again, comparative 
analysis of these entries against total entries in the AiutAoLain EdaccuUon 
IndnK was not possible. Although an accession numbering system had been 
introduced for indexing entries during the period of this search, non-journal 
documents are also included among the numbered entries. Among the 21 
articles, 9 articles related to general developments in the selection and 
evaluation of curriculum materials, 1 article related to teacher education 
for selecting and evaluating curriculum materials, an 11 articles related 
to research about the selection and the evaluation of curriculum materials 
for bilingual-bicultural education, multicultural education and related areas 
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Table 6 shows the number of articles identified in each of the 18 journals 
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Table 6: Articles indexed in the Aiut^atLan Edacation Index, by Journal and 
Year of Publication. 



Aiut^aZian A(hUntUAation 

Aiut^txitian Jou/cmZ oi 
AduZt EducojUon 

Au^t^LOtixin JouAmZ 
EoAZy Cklidhood 

AuMJiaLian Jou/inaZ 
Rmding 

Aiut/ujtZian JouAnaZ OjJ 
Rzme.cUcLZ EckLcaZLon 

CuM.'is.uIum ?2A^pZ(iti.\}(U 

Education L^AoAy SzAvict 

EnglLik An AuMamZLo, 

JouAnul 0(J CivtAicjuJbm 
Studies 

JouAmJL oi thz Sckool 
L^MJiy Ai^ocAoZLon. oi 
Quzzn^iand 

UvuUlcuZtuAol EdiicatLon. 

Oxam, 

Polycom 

Rzading Atoand 

Study 0^ So<Uzty 

TQjOLchlnQ ojj Engtuk 

VAT 

TotaZ Uwitb2JU> 
TotaZ ?2Acmta,QZ 



1978 1979 1980 1981 1982 1983 1984 1985 TOT 

1 1 

1 1 

1 1 

2 2 

1 1 

2 2 

1 1 

1 1 2 

1 1 

1 1 
1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

1 1 

4 1 5 1 6 2 2 21 

19.0 4.8 . 23.8 4.8 28.6 9.5 9.5 10( 
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These 18 journals represented 10.1% of a total number, averaging at 
178.5 journals per annum, indexed in the Aa^tAcutian Educcutlon IndzK 
during the six-year period of the search. An examination of the 18 
journals by country of publication indicated that 17 journals (94.4%) 
were published in Australia, whilst the one remaining journal (5.6%) 
was published in the United Kingdom. On this basis, an examination of 
the 21 journal articles showed that 20 (95.2%) were published in Australia 
and one (4.8%) was published in the United Kingdom. 

2.2.3 B/UtUh Educcution JndzK 

2.2.3.1 The Procedures 

The search through the EnJjtU^h Educcutlon Indzx was conducted manually to 
include the period, January 1980 through to December 1985. The procadure 
adopted to identify relevant articles varied from the searches conducted 
in the other information retrieval systems, because subject headings were 
constructed through a differently structurec ossification, the Preserved 
Context Index System. The unavailability of hesaurus of terms required 
the searcher to scan the subject index, to idem fy those descriptors 
most likely to contain entries related to the field of interest. The 
following descriptors were selected as being the most relevant to the field 
bilingual education; multicultural education; teaching materials; and 
textbooks. Identification was made on the basis of the relevance of 
minor descriptors and the relevance of each article's title. Although 
it was not possible to accept or reject articles with the same precision 
that occurred with the E.R.I.C. entries, the inclusion of articles in the 
appendix was based upon the same criterion used for inclusion of 
documents and articles from the E.R.I.C. databases. This criterion 
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specified that the document included subject matter that related substantiall 
to selecting and evaluating curriculum materials, including the evaluation 
of bias. Once selected, these journal articles were classified as either 
methodologies or studies within each type of research. The articles are 
listed in Appendix 4, alphabetically by author, followed by publication 
date, article title, journal title, volume number, pagination, and 
British Education Indzx volume number and pagination for the description 
of the entry. 



2.2.3,2 The Results 



Again, publication of research about selecting and evaluating curriculum 
materials appears to be poorly represented in journals indexed in the 
Bnyituk Education Indzx. A total of 13 articles, indexed during the 
period covered by the search, were identified. However, comparative 
analysis of these entries against the total entries in the B^Uti^h 
Educcution Indzx was not possible because an accession numbering system 
is not used for indexing entries. Among the 13 articles, 4 related to 
general developments in the selection and the evaluation of curriculum 
materials, and 9 related to research about the selection and evaluation 
of curriculum materials for bilingual-bicul tural education, multicultural 
education and related areas. 



Table 7 shows the number of articles identified in each of the 10 journals, 
for each year of publication. These 10 journals represented 3.4% of a 
total number, averaging at 293.5 journals per annum, indexed in the 
BnAXAj^k Education Indzx during the six-year period of the search. An 
analysis of the 10 journals by country of publication indicated that 9 
journals (90.0%) were published in the United Kingdom, and 1 journal 
(10.0%) was published in Belgium. An examination of the 13 journal 



Table 7: ..Articles indexed in the WUtUk Education Indzx, by Journal 
and Year of Publication. 



1978 1979 1980 1981 1982 1983 1984 1985 TO' 

Education 3-13 1 1 
Engti6k Languuigz TzcuctUng 

JoiJJinaZ 112 
Eu^opdon Journal 0^ 

Education 1 1 
Journal A^ocMitLon OjJ 

ToxLckzu oi ItaJUan 2 2 

Joa^nai OjJ Cu/uUcuIm StudAz^ 1 1 

Linky^ 1 1 

School LibAoAian 1 12 

ScizntLa Pae^dagogica EKpQAimzntatU> 1 1 

Signal 1 1 

ToxictUng GzogM:phy 1 1 

Total NumboA^ 2 3 3 3 1 1 Ic 

Totdt PoJiczntagz . 15.4 23.1 23.1 23.1 9.7 9.7 IC 
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articles showed that 12 (92.3%) were published in the United Kingdom 
and 1 (7.7%) was published in Belgium. 



2.3 Discussion 

An analysis of the litere^ure, idf ntified from the information systems, 
allows certain conclusions to be drawn about characteristic features of 
the research in this field. These features include interpretations 
derived from both statistical analyses of quantitative data and inferences 
made about the sources of the research. No attempt has been made to 
provide qualitative judgments about the research that has been conducted. 

Five conclusions can be drawn from the statistical analyses of research 
in this field. Firstly, such research is poorly represented, at generally 
less than one percent, among all educational research. Secondly, the 
generic- and the subject-oriented types of research accounted for the most 
substantial part of research conducted whilst research that related to 
teacher education has been particularly neglected. Thirdly, no 
statistically significant difference was determined between the trend for 
research conducted in this field and the trend for all educational research 
indexed in the Re^ou/Lce^ Education database. Fourthly, articles 
indexed in the CixnAznt Index to JouAnaJU tn Edaaatton, the kiiiit/voJUjoin 
Eduacutton Indtx and the 'B^hAjbUk Eduaatton Indzx during the period of the 
search, had been published by only a small minority, generally less than 
ten percent, of educational journals. Finally, a significant difference 
was found between the quantity of publication of articles by journals in 
different countries. as represented by articles reviewed for entry in the 
CuAAtnt Indzx to JouAnaL^ In Education. 
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Although the author has concentrated upon presenting analyses of quantitative 
data in this chapter, qualitative interpretations have been made about the 
documents indexed in the Re^ooAce^ In BduaatLon database. This aspect of 
the analysis indicated that the documents originated from diverse 
educational sources that represented all types of educational institutions. 
Publication of documents in this field, however, was concentrated in certain 
educational institutions: particular universities; particular educational 
research institutions; particular professional organisations; state 
education departments; and conference organisations which were usually 
linked to professional organisations. In contrast, proportionally less 
research emanated from federal educational agencies including research and 
development centres and regional educational laboratories, education service 
centres, school districts and educational projects. 

2.4 Conclusion 

The findings from the analysis of the literature in this field generally 
supported the hypothesis for conducting the search. The purpose of the 
search was to identify and document activities occurring within the field 
of interest, to survey the extent of activities occurring within the field, 
and to draw upon these activities to extend the scope of the proposal for 
a teacher education program presented in this paper. 

The analysis of the literature in this field identified the characteristic 
features of this research. These features were established by interpreting 
statistical analyses of quantitative data about research in this field 
and deriving inferences about the sources of the research. Furthermore, 
certain types of educational institutions were identified for being 
reponsible for contributing a greater proportion of research in this field. 
It could be inferred that the American institutions - the Social Science 

ERIC 46 



Education Consortium and the Educational Products Information Exchange 
Institute - were the predominant forces in conducting activities in this 
field.. To this extent, conclusions derived from the search verified 
the selection of the institutions discussed in Chapter 3. 

The search also provided a basis for extending the scope of the proposal 
for a teacher education program presented in Chapter 4. Although the 
quantity of teacher education modules identified through the search was 
small, and they varied considerably in their quality, taken together their 
statements of objectives, contents, activities, and means for assessment, 
provided a helpful basis for extending and validating the proposal. 
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3. REVIEW OF IMSTiTUTIONAL ACTIVITIES 



Institutional activities in the selection and evaluation of curriculum 
materials are not extensive. A comparative survey of such activities 
has been undertaken by Eraut at. (1975). Seven evaluative instruments 
were identified from the following sources: Social Science Education 
Consortium, Boulder, Colorado, U.S.A. (1968); Far West Laboratory for 
Educational Research and Development, San Francisco, California, U.S.A. 
(1970); Eash (1972); Educational Resource Centre, St. Gallen Canton, 
Switzerland (1972); InstitUt fUr die Pedagogik der Naturwissenschaften, 
University of Kiel, German Federal Republic (1973); National Board of 
Education, Stockholm, Sweden (1974); and the Centre for Educational 
Technology, University of Sussex, Brighton, United Kingdom (1975). 

A basic criterion is defined by Eraut oX aJi. as fitting each of these 
instruments: providing an organised set of techniques that can be applied 
to the evaluation of the characteristics of curriculum materials. The 
authors have distinguished three functions which these instruments fulfil 
to greater or lesser extents: descriptive analysis; evaluation; and 
decision-making. Descriptive analysis stresses not only description of 
curriculum materials but also concentrates upon elucidating their 
rationale and structure. Evaluation provides the capability to judge 
curriculum materials against a range of criteria. Decision-making 
provides judgments allowing users to select and implement curriculum 
materials • 

Only the instruments developed by Eash, and later adapted for extensive 
use by the Educational Products Information Exchange Institute, and the 
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Centre for Educational Technology are designed for general use. The 
majority of these instruments are subject-specific: the instrument 
developed at the Social Science Education Consortium was designed for 
social studies; the instrument developed at the Far West Laboratory for 
Educational Research and Development, for elementary science; the 
instrument developed at the Educational Resource Centre, for elementary 
mathematics; the instrument developed at the InstitOt fUr die Pedagogik 
der Naturwissenschaften , for science; and the instrument developed at the 
National Board of Education, for secondary mathematics. Such subject- 
specific characteristics, however, have had little influence upon the major 
features of each instrument since such characteristics are almost 
entirely confined to details. 

Attention in this chapter, however, will only be given to those instruments 
applicable to general use, to subject-specific use for bilingual-bicultural 
and multicultural education and related areas, and to application in teacher 
education. Those instruments related to mathematics and the sciences 
will not receive further consideration in this paper. Discussion will 
concentrate upon the instrument developed by the Social Science Education 
Consortium because of its application to the evaluation of curriculum 
materials for multicultural education. The instrument developed at the 
Centre for Educational Technology, and adaptations used by the Educational 
Products Information Exchange Institute of the instrument developed by 
Eash, will be considered because of applicability to general use. In each 
case, particular attention will be given to developments in teacher 
education. Developed independently of the previous activities are a 
small number of instructional guides which provide teacher education in 
the skills of selecting and evaluating curriculum materials. These 
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guides will be discussed in the latter part of this chapter. 



3.1 Social Science Education Consortium 

The Social Science Education Consortium was established during 1963-1964 
at the University of Colorado, Boulder, Colorado. Its aims are to 
collect and disseminate materials for social studies education, to support 
development and implementation of new social studies materials and to 
improve working relationships between personnel in various social studies 
education projects. 

3.1.1 The Process for Selecting Curriculum Materials 

Davis and Eckenrod (1972) provide an account of procedures recommended by 
the Social Science Education Consortium for selecting curriculum materials 
for social studies. Two major steps are involved in this process: firstly, 
a statement of broad program goals, such as the guidelines developed by the 
National Council for the Social Studies, can be used to identify available 
curriculum materials; and secondly, evaluation of curriculum materials that 
appear to support the program goals by use of the Social Science Education 
Consortium's CuAAlcixZm Mcute/Uat6 kmLi^J^JU Sy^tm. 

3.1.2 The Evaluation Instrument 

Morrissett oX al. (1968) report the development of an instrument to evaluate 
curriculum materials. The instrument originated informally as a brief form 
containing a dozen or so questions. This form was revised and enlarged on 
several occasions but was first formally applied as part of activities 
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undertaken with the Wabash Valley Education Center, Indiana, early in 1966. 
The original version of this instrument, published by Morrissett and Stevens 
(1967), comprised the following sections: 1.0 Descriptive Characteristics; 
2.0 Rationale and Objectives; 3.0 Antecedent Conditions; 4.0 Content; 
5.0 Instructional Theory and Teaching Strategies; and 6.0 Overall Judgments. 
No sooner had this original version of the CixAlcuZm MatoAlaZ^ Analyst 
Sy6tm been published than an initial revised version was published (Stevens 
and Morrissett, 1967-1968; Stevens and Fetsko, 1968). This version was 
the result of reworkings conducted at conferences sponsored by the 
Educational Products Information Exchange Institute at Lake Mohonk, New 
York in 1966 and at Purdue University in April 1967. Further reworkings 
of the instrument also occurred as a result of a conference held at the 
University of Colorado in May 1968, and of criticisms and suggestions for 
revision contributed by Charles Adair, Frances Klein, Michael Scriven, Hilda 
Taba.and Louise Tyler. In May 1971, a second revised version of th' 
instrument (Social Science Education Consortium, 1971) was published, 
containing short, intermediate and long forms, and including two 
additional sections. This version was arranged as follows: 1.0 Product 
Characteristics; 2.0 Rationale and Objectives; 3.0 Content; 4.0 Theory 
and Strategies; 5.0 Antecedent Conditions; 6.0 Evaluation; 7.0 Background 
of Materials Development; and 8.0 Background of the Analysis. Analyses 
of social studies curriculum materials undertaken by the Social Science 
Education Consortium, using a two-page framework derived from the 
CiiMlcixZum MatQAMiLs knaZy^Aji Sy^tm^ are published in successive editions 
of the SocJjxl StucLioA CuAAlauZm ^atoJujcdU Vcuta Book. 

Eraut eJ: aZ. have provided a critique of Morrissett and Stevens. They 
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indicate that this instrument employs an objectives model of the curriculum. 
Theoretical considerations characterise the instrument. In their analysis, 
they state that this instrument combines analytical and descriptive features 
whilst incorporating a separate evaluation section. 

The Social Science Education Consortium has also undertaken a major role in 
the selection and evaluation of curriculum materials for the Ethnic Heritage 
Studies Program. The CunAlcuZm l^atQJujaZ^ knoJiy^Jji Sy^tm was adapted for 
use in the Ethnic Heritage Studies Curriculum Materials project that 
commenced in July 1974. This instrument (Social Science Education 
Consortium, 1975) comprises two parts: firstly, an extended form; and 
secondly, a short form compiled from the third and fifth sections of the 
extended form. The short form is intended for classroom teacher use in the 
evaluation of curriculum materials or as a tool for demonstration at teacher 
education workshops. Four of the five sections of the extended form deal 
with the educational qualities of curriculum materials: 1.0 Product 
Characteristics; 2.0 General Educational Quality of Materials; 4.0 
Adaptability of Materials to Conditions of Use; and 5.0 Overall Evaluation. 
The third section, 3.0 Ethnic Heritage Content, concentrates upon the 
treatment of ethnic groups in terms of stereotyping, realism, accuracy and 
development of intercul tural understanding. Except for the section. 
Product Characteristics, of the extended form, items within both forms of 
this instrument are based upon a six-point rating scale. 

3.1.3 Applications to Teacher Education 

The authors cite eight possible uses of this instrument (Morrissett dt a£. ): 
general library use; analysis of trends within curriculum materials; 
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field data collection about classroom use of curriculum materials; 
decision-making in the selection of new curriculum materials; provision 
of analyses of curriculum materials in terms of a curriculum model; 
promotion of all dimensions of curriculum development; introduction of 
new ideas and approaches in curriculum materials through inservice 
education; and acquainting preservice teacher trainees with the range of 
curriculum materials and the ability to perform their own analyses. 

Application of several of these uses, including inservice education, 
have been reported by Morrissett a£. and Davis and Eckenrod. Use of 
the CuAAicuZm Matznlat^ Anaty^yU Sy^tm in teacher education has been 
applied not only to developing skills of teachers in selecting and 
evaluating curriculum materials but also to stimulating teacher involvement 
in curriculum philosophy and to constructing curriculum models. Davis 
and Eckenrod report that the CuAAlauZm l^atvilaJU AmZy6i6 Sy^tm 
has been used in workshops, conferences and academic programs throughout 
the United States of America. Morrissett oJ: at, report that the 
CvJUvidiiZm lAat2XiciU^ AnaZy^iA Sy^tm was used for training purposes at 
the 1966-1967 Experienced Teacher Fellowship Program at Purdue University 
and the 1968-1969 Experienced Teacher Fellowship Program in Economic 
Education at the University of Colorado. Davis and Eckenrod report that 
the CuAAicixZm Mat2JUcit6 Analy^yU Sy^tm has been applied to inservice 
teacher education in Team Regional Inservice Analysis and Dissemination 
projects which aimed to assist school districts engaged in selecting new 
social studies curriculum materials. Using this instrument, teachers 
and supervisors in different school districts undertook analyses of 
materials available for purchase and then shared their results with other 
members of their group and with groups in other school districts. 
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3.2 Educational Products Information Exchange Institute 



Educational Products Information Exchange Institute was established as an 

independent organisation on 1 August 1967, although formerly operating as 

a division of the Institute of Educational Development. Komoski (1967) 

has detailed planning for the Educational Products Information Exchange 

Institute during the formative years of its development. 

"Plans and procedures include meetings between users and 
producers of equipment to discuss what characteristics of 
'hardware* need be described to permit informed selection. 
Professionals at two universities have devised procedures 
for analyzing content and explicating the pedagogical 
assumptions underlying the make-up of instructional 
materials. Interview protocols for use with teachers 
have been devised and tested, as have methods for training 
school personnel to use EPIE information collection 
techniques. A pilot study of the entire system has been 
designed, and a preliminary version of a comprehensive 
systems design for the Exchange has been completed and is 
being revised in preparation for the proposed pilot study" 
(1). 

This pilot study aimed to establish a national system to collect, 
evaluate and disseminate information about educational products to all 
sections of the educational community. Today, the Educational Products 
Information Exchange Institute operates in both the United States of 
America and Canada, maintaining Executive Offices at Water Mill, New 
York, a Program Development and Research Office at the Teachers College, 
Columbia University, New York, whilst a Western Projects Office is 
located at Berkeley, California and a Northeastern Projects Office is 
situated at Dresden, Maine. 



The Educational Products Information Exchange Institute is currently 
involved in selecting and evaluating textbooks, audiovisual and video 
equipment, microcomputer hardware and software, and in disseminating 
information about these educational products through printed reports 



and computerised databases. Komoski (personal communication, 1986) 
reports that the Educational Products Information Exchange Institute 
operates "education's largest database of information on microcomputer 
software, which is widely used by schools throughout the U.S.A. and 
Canada for selecting software. This database. The Educational Software 
Selector (TESS) is also used to produce a hardcopy 'software encyclopaedia' 
published annually by the ERIE Institute and the Teachers College Press". 
Another database, termed the Integrated Instructional Information 
Resource (IIIR), is now being developed to provide Curriculum Alignment 
Services for Educators. The Curriculum Alignment Services for Educators 
are aimed at improving school performance by ensuring that all educational 
products — textbooks, supplementary materials, computerised software 
programs, videotapes and tests — are carefully aligned with a school's 
chosen curriculum objectives. 

3.2.1 The Process for Selecting Curriculum Materials 

Selection of instructional materials by committees is advocated by the 
Educational Products Information Exchange Institute. Selection committees 
should be based locally and should consist of administrators, teachers, 
parents, students and other members of the community. Systematic training 
of committee members is viewed as essential. Selection involves 
determining prospective users for particular instructional materials and 
is governed by the instructional design of the materials and the 
characteristics of the setting in which the materials will be used. 

Sequential steps to be taken by selection committees are to review and 
examine available materials within a field of interest through the use 
of checklists and rating scales. Then, selection committees screen these 
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materials by means of appraisal forms based upon cooperatively agreed-upon 
criteria related to both the materials and the appropriate instructional 
setting, Komoski (personal communication) reports that "recently, EPIE 
has added the use of computer-generated curriculum alignment reports as 
an important element to be used in the screening process". On the basis 
of this screening, selection or production of materials can be made 
within a 'decision arena* of five alternative courses used alone or in 
combination: continued use of existing materials within existing programs; 
selection of materials on the bases of learner and teacher characteristics 
and approach to instruction; development of materials locally, regionally, 
or at a state level; initiation of inservice training of personnel in the 
use of materials and implementation of programs; and initiation of broader 
curriculum development for the appropriate programs. 



3.2.2 The Evaluation Instrument 



The instruments used by the Educational Products Information Exchange 
Institute to evaluate educational products are adaptations of an original 
instrument published by Eash (1972) • Eash's instrument contains five 
sections: I Objectives; II Organization; III Methodology; IV Evaluation; 
and V Comment. Eraut e-i aZ. have criticised Eash's instrument, labelling 
it a behaviourist, goal-based model of curriculum development. They 
state that this instrument combines description with analysis in only a 
limited way in relation to objectives, organisation of the material, 
methodology and evaluation. Stressing evaluation, this instrument 
merges evaluation with descriptive analysis but fails to provide users 
with decision-making information. 

Following adaptation by the Educational Products Information Exchange 
Institute of Eash's instrument, Elliott (personal communication, 1985) 
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has reported that the first version of EPIEform A was developed in response 



to feedback from participants at a workshop in which Eash assisted the 

Educational Products Information Exchange Institute train teachers in 

California to use his instrument to analyse textbook programs in reading. 

The fundamental alterations that occurred in the transition from Eash's 

instrument to EPIEform A are best related in Elliott's words. 

"The main issue that led to the feedback and the revision 
focused on whether EPIE analyses should favor some specific 
instructional design provisions over others or simply describe 
the provisions made in each set of materials and leave it to 
the selector to express preferences. In the Eash instrument 
with which we started the training in Los Angeles, analysts 
were asked to rate a number of instructional design features 
on a scale of ten (e.g., fully stated 'behavioral' objectives 
were given the highest rating and very general outcome 
statements the lowest). In the EPIEform A version that 
emerged from these sessions, analysts were asked to describe 
each instructional design provision as precisely as possible 
(e.g.. Objectives give check all that apply : a, expected 
behavior/s, b. conditions under which it/they should occur, 
c. performance standard, d. other ). 

The original Eash instrument was based on a single point 
of view about what constitutes good instruction; EPIEform 
A allowed for alternative views and stressed making a good 
match between: (1) user needs and preferences and (2) one 
or more of a number of different approaches built into the 
sets of materials available on the market...'* 



The purposes of EPIEform A have been to provide useful information for 
users and guidance about the selection of educational products. A 
significant feature of this instrument has been its capacity for 
adaptation to different educational contexts and for revision based 
upon criticisms received from educators who use EPIE Reports. During 
1984, major revisions were undertaken to the version of EPIEform A applied 
to the analysis of textbooks (Educational Products Information Exchange 
Institute, 1985). This revised version comprises four sections: 
Contents (scope, content organisation, and other content considerations); 
Methodology (typical lesson/learning approach, levels/types of thinking 
in learning activities, provision for extension/enrichment activities 
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and comment on methodology); Tests and Assessment (description of provisions, 
comments on tests and assessment); and Other Considerations (program 
implementation, technical quality of program materials, summary and 
goodness of fit, analyst's summary comment). As a result of these changes, 
Elliott indicates that "future ERIE Reports will contain more critical 
comments about such matters as the clarity of learning activity instructions 
and the *considerateness' of the text narrative, while maintaining 
neutrality concerning instructional approaches or philosophies". 

3.2.3 Applications to Teacher Education 

The Educational Products Information Exchange Institute has been active in 
teacher education since 1973-1974, when a program to train teachers in 
analysing instructional materials was introduced in Pennsylvania and 
California, and was later extended to other states and Canada the 
provinces of Alberta, British Columbia and Manitoba (Wood, 1981). For 
this purpose, EPIE training Form I was published (Educational Products 
Information Exchange Institute, 1977). This instrument is designed 
for either class use or self-instruction. The instrument is a variant of 
EPIEform A, which was being used at that time to analyse curriculum 
materials. EPIE training Form I comprises the following parts: 
I Product Identification and Background; II Instructional Design Constructs 
(A. The First Instuctional Design Construct: Intents, B. The Second 
Instructional Design Construct: Contents, C. The Third Instructional Design 
Construct: Methodology, D. The Fourth Instructional Design Construct: 
Means of Evaluation); III Instructional Design Fit; and IV Other 
Considerations (Content Authenticity: Accuracy, Fairness, and Currency). 
EPIE training Form I specifies a s6t of common criteria on which *:trainees 
must base their descriptive, analytical and evaluative comments about a 
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analytic process, and examples of statements for each design construct 
are appended. 



Komoski (personal communication) reports that "in 1981-1982, the EPIE 
Institute designed an instrument for evaluating microcomputer software. 
It was developed by the EPIE Office of Research at Teachers College, 
Columbia University. Since its initial development, it has undergone 
four revisions, all of which reflect new levels of development in the 
evaluation of computer software. The form is used by trained teams of 
evaluators who analyse the software's design (instructional and technical) 
and who also gather user data to assess a program's effectiveness". 

Educational Products Information Exchange Institute (n.d.) has developed 
a module for use in providing educators with the knowledge and skills to 
evaluate all types of educational materials. Two ways for determining 
analysis of materials are presented in the module: application of four 
curriculum constructs — intents, contents, methodology and evaluation — 
to provide qualitative analysis of materials; and correlating concepts, 
textbooks, supplementary instructional materials, computerised software 
programs, films, videotapes and tests to provide quantitative analysis of 
materials. 

Qualitative analysis is presented through demonstration and discussion of 
six concepts: / ^earning Materials Continuum; Ralph Tyler's Rationale; 
Educational Products Information Exchange Institute's Curriculum Analysis 
Framework; A Bridge 'Analogy' of the Curriculum and Instruction Process; 
Internal and External Curriculum Congruence; and Development of an Integrated 
Instructional Information Resource. Quantitative analysis focuses upon 
matching concepts and educational materials in Curriculum/Content/Evaluation 
Correlation, and linking this process to the Integrated Instructional 
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information Kesource and Its application In the Curriculum, Text, Test 
Matching Service, now the Curriculum Alignment Services for Educators. 

The materials used at workshops, in conjunction with the- module, comprise 
a videotape presenting Kenneth Komoski's explanation of the concepts of 
curriculum and instruction integrity, eleven handouts (1. 'Concepts of 
Curriculum and Instruction Integrity', 2a. 'Learning Materials Continuum*, 
2b. 'Glossary of Instructional Design Terms', 3. 'Analysis Sheet 
Flow Charts', 4. '"What Should Drive the Curriculum?" Exercise, 5. 'An 
Introduction to Curriculum/Content/Evaluation Correlation and Integrated 
Instructional Information Resource', 6. 'Analysis Sheet for Curriculum, 
Text, Test Matching Service Sample', 7. 'DEMO — Curriculum, Text, Test 
Matching Service', 8. 'Conclusion and Debriefing of Curriculum/Content/ 
Evaluation Correlation', 9. 'ERIE PRO/FILE SCIENCE', 10. 'Micro- 
Courseware PRO/FILE-Fractions 1' and 11. 'Bibliography'), and seven 
transparencies for overhead projection. Handouts 1 through 4 are used 
in the first part of the workshop and handouts 5 through 11 are used in 
the second part. 

The workshop is designed to run for six hours' duration over a single day 
with a lunch break dividing the two parts. The following sequence is used 
for presentation of the workshop materials. The workshop leader introduces 
part one. Qualitative Analysis, through a question-and-answer pre-test, 
'What Should Drive the Curriculum?'. Following this introduction, the 
participants view the videotape, followed by presentation of Handout 1. 
Questions, discussion and review of this handout then proceed. The 
Learning Materials Continuum which refers to an arrangement, according 
to their intentions, of the different types of educational materials from 
least to greatest complexity, Ralph Tyler's Rationale, based upon a 
statement of the objectives model contained in his publication (Tyler, 1950) 

..•45 

ERiC 60 



and A 'Bridge' Analogy, which refers to the transactional relationships 
established between the developer of instructional materials, the curriculum 
process and the learner, are then introduced. Participants, then, apply 
these qualitative concepts to complete two exercises: a learning materials 
continuum exercise, using Handouts 2a and 2b, to classify a set of 
miscellaneous materials; and a flow chart exercise, using Handout 3, to 
apply Tyler's rationale, the Curriculum Analysis Framework, the 'Bridge' 
Analogy and Internal -External Congruence to analysing the linking of 
curriculum constructs in a textbook. TUe final section in part one is 
intended to answer the question, 'What Should Drive the Curriculum?'. 
Participants use Handout 4 to undertake two exercises describing what 
preferably, and then what actually, drives the curriculum. 



Part two introduces qualitative analysis through examinations of curriculum/ 
content/evaluation correlation and the Integrated Instr^uctional Information 
Resource. Handout 5, designed as a cloze procedure, informs participants 
about how concepts, objectives of textbooks and tests are matched. Following 
the workshop leader's explanation, participants complete this exercise. 
Next, participants are informed about how the Integrated Instructional 
Information Resource database can be used to process such matches by 
indexing five subdivisions for concept development: developing the concept; 
reviewing the concept; practicing the concept; testing the concept; and 
word problems. Participants then examine more closely samples of the 
Text/Test Matching Service now termed the Curriculum Alignment Services for 
Educators. Participants then complete the questions contained on 
Handout 6. Once this exercise is completed, participants read Handout 7 
which provides an example of application of the computerised database. 
Finally, conclusion and debriefing are intended to combine the important 
themes discussed during the workshop: curriculum/content/evaluation 
correlation; steps for selecting educational materials; the Educational 
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Products Information Exchange Institute's service providing qualitative 
analyses of textbooks and courseware; and learner verification and revision. 
Participants then refer to examples of qualitative analysis of a textbook 
contained on Handout 9 and qualitative analysis of a microcourseware 
contained on Handout 10. 

To counteract what are now viewed to be both inadequate procedures and the 
widespread use of dubious practices for textbook adoptions, the Educational 
Products Information Exchange Institute is promoting a utilisation policy 
which extends the process of adoption beyond selection of curriculum 
materials to their use in the classroom. A principal feature of this 
utilisation policy is to provide teachers with support, training, monitoring 
and communication with other teachers about matching curriculum materials 
to the capabilities of individual students. An instrument, the Peg/Lee^ 
RdadLLng Vovovi^ based upon the Bormuth readability formula, has been 
developed by the New York Department of Education. The Vug/izz^ OjJ RdadLing 
?ovo2A can be employed for diagnostic assessments of both students and 
curriculum materials. 

The Educational Products Information Exchange Institute (1986a) has developed 
a set of modules to facilitate the training of teachers in relation to the 
implementation of the Peg/tee^ oi Reading VovooJi in school districts. The 
modules are intended to be used in EPIE training workshops or can be used 
at school -based workshops. 

The material consists of seven modules and an appendix: Module 1 is titled 
An Overview of the Degrees of Reading Power (DRP) System ... A Stand-Alone 
'Awareness* Module; Module 2 is titled The Degrees of Reading Power (DRP) 
System Explained; Module 3 is titled Comparing the DRP System and CAT-MAT 
Type Reading Comprehension Tests; Module 4a and 4b is titled The DRP and 
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the Readability Level of Ir)structiona1 Materials: Helping Teachers to 
Assess the Readability of Unanalyzed Materials; Module 5a and 5b is titled 
Creating CLOZE Exercises for Comprehension Instruction; Module 6 is titled 
Selecting Commercially Produced CLOZE Materials; Module 7 is titled 
The DRP System: Summing Up; and the appendix is titled Book Readability 
Measures. The organisation of the contents of each module is similar, 
providing statements about the module's rationale, objectives, methodology, 
time requirement, equipment, materials, preparation, general instructions 
and specific instructions. Sets of handouts are appended to each module. 
Sessions run for a duration of 35 to 50 minutes each. 

Module 1 is intended to be used only in circumstances where the remaining 
modules cannot be implemented, and, as such, should be used independently. 
The three main concepts of the Peg/tee^ Rzadtng Po(a)2A — the assessment 
of students* reading ability through the use of cloze passages, the 
assessment of the readability of materials, and the computer-based matching 
of materials of appropriate difficulty to students — are treated. 
Participants are presented with three handouts: The DRP System — What is 
it?; Sample DRP Passage — Drawbridge; and DRP Matching of Students and 
Instructional Materials. 

The objectives of Module 2 are, firstly, to present the theoretical 
presumptions about the acquisition of reading skills that underlie the 
Vzgn.zeA RzadUng Voimqji^ secondly, to introduce the characteristics of 
the Vzgn.zeA RzadLLng PoiooA test, and thirdly, to introduce applications 
of the Vzg/iz(U oi RzacUng Poia)qa system. Prior to attending this session 
at a training workshop, participants are expected to complete a 
questionnaire. and locate their students' Vzg/izz6 oi RzadUng Pouoqa scores. 
Through discussion with the workshop leader and reading, the participants 
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examine four handouts in sequence to achieve the first objective: Handout 
A, Matching Students to Books with the DRP System; Handout B, A Man is 
Building a Boat; Handout C, Hunting; and Handout D, The Reading Process — 
A Flow Chart. Participants are then informed of the characteristics of a 
VzQfiZQJs oi RzadUng Pouoz/i test: that examinees must process extended prose 
passages, each in excess of 325 words; that the Oeg/Lce^ RzacUng Po(a)qa 
test is not a vocabulary test; and that the Peg/tee^ RQadUng Pou)qa test 
is not culture-bound nor a measure of prior knowledge. The participants 
achieve the second objective by examining three handouts in sequence: 
Handout E, Bridges — DRP Test; Handout F, * Astronomical* Radiation — 
DRP Test; and Handout 6, Readability of Periodicals. During this session, 
participants also require copies of the original materials of the Peg/tee^ 
0(J RzadUng VovooJi instrument: the Readability Report; the User's Manual and 
Peg/Lce^ RzacUng PoiA)QA test form CP-1. 

The objectives of Module 3 are, firstly, to compare the assumptions of the 
Peg/Lee^ oi RzacUng Pou)qa test with norm-referenced achievement test batteries 
(in this case, the Cabi^okyUa AchlzvojfmnX, T(L^t6 and the UidtJiopoLitoin 
Achlzvmznt Tz^tb) which assess reading comprehension as a set of subskills; 
secondly, to discuss these differences; and thirdly, to demonstrate the 
reporting of the Peg/tee^ RoxidLLng Pou)qa scores. Participants achieve 
the first objective through discussion and reading Handout A, California 
Achievement Reading Test Items Weighted by Subskill. The second objective 
is achieved through discussion about the lack of relationship between 
grade equivalent scores on norm-referenced tests and grade levels assigned 
through readability formulas. To achieve the third objective, participants 
read Handout B, DRP Matching of Students and Instructional Materials. 
This handout illustrates the computer-based matching of examinees* Peg/tee^ 
OjJ RzacUng Poia)qa scores, indicated at an independent level, three 
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Instructional levels and a frustration level, with the Vzg/iziU 0(J Reacting 
Pou)QA readability ranges for textbooks. 

Unlike the previous modules. Module 4 is to be presented in two sessions. 
The objectives of this module are to apply the RzadLLng Pouoqa 

readability formula to determine levels of difficulty of curriculum 
materials; to rank and analyse the range of prose passages using the 
Peg/tee^ RzadLLng Pou)qa readability formula; and to have participants 
practise approximating readability levels on sample prose passages. In 
the first session, participants use Handout A, DRP Analysis of Passage 25, 
to determine how a Peg/tee^ 0(J RzadUng Pou)qa readability level of a prose 
passage can be obtained through measures of word length, sentence length 
and the proportion of 'familiar' vocabulary. By referring to Handout B, 
A Comparison of Publishers' Designation with 6 Readability Formulas for 
the Ginn Reading 720 Series, and Handout C, Readability Variations within 
Textbooks, participants understand that the Peg/tee^ RdacUng Povoqa 
readability formula is not used to report grade equivalent scores or 
average readability scores but the range of reading difficulty for 
curriculum materials. Using Handout D, Set of 5 DRP Paragraphs, and 
Handout E, Set of 4 DRP Paragraphs, participants apply this knowledge to 
rank prose passages according to their perceptions of each passage's 
difficulty. In the second session, participants use the Peg^ee^ oi 
Rzading Pou)qa readability formula to measure the reading levels of three 
prose passages containing subject matter in social studies as shown on 
Handout G, Social Studies Passages. Through discussion with the leader, 
participants use Handout H, DRP Analysis of Social Studies Passages, to 
check their estimations of the Vug^noA RdadLLng PoiJOOA levels jfor each . 
passage. In conclusion, participants are asked to rank four passages 
of similar Peg^eei oi Rzading Poi^oA levels shown on Handout I, Sample 
Book Pages. .Participants will then understand that differences between 
different materials, such as illustrations, photographs and print size, 
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provide a misleading indication of reading levels. 



Module 5 is also to be presented over two sessions. The objectives of 
this module are to practise identifying the characteristics of effective 
cloze exercises and to apply these characteristics to developing cloze 
exercises. In the first session, participants are informed about a set of 
guidelines for selection and creation of cloze passages by examining 
examples shown on Handout A, Guidelines for Selection and Creation of Cloze 
Exercises. Participants then use the sample cloze passage shown on Handout 
B, Refining Cloze Response Options, to determine guidelines for each 
deletion shown in the cloze passage. Then, the participants examine 
Handout C, More Practice Refining Cloze Options, and provide reasons for 
eliminating two of the alternatives for each deletion. For Handout D, 
Creating Options for Cloze Exercises, the participants are asked to create 
their own alternatives for each deletion. In the second session, participant* 
examine Handout E, Generative Cloze Passages, to determine which 
alternatives for each deletion they wr ^ perceive to be acceptable to 
students. Handout F, Making Good Cloze Deletions, is supplied in two 
editions: a participant's edition which shows no deletions; and a leader's 
edition which indicates seven possible deletions, each supplied with five 
alternatives. The participants are required to make five deletions, 
underline cues and supply a set of alternatives for each deletion. 

The objectives of Module 6 are, firstly, to identify criteria used to 
select commercially produced cloze materials, and secondly, to apply these 
criteria to selecting cloze materials. The participants examine and 
discuss the criteria shown on Handout A, Criteria for Selecting Cloze 
Materials. The participants, then, use Handout B, Ranking Sheet, to 
appraise and rank available cloze materials. 
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The objectives of Module 7 are to reinforce the topics presented in this 
set of modules, to discuss the instructional significance of the I?eg/tee>6 
of^ RdacUng Pou}aA system, and to discuss the participants* plans to 
implement the Peg^ee^ o/J Reading Vomn. system. Four issues are presented 
for discussion with the participants: the Peg/tee^ RdadUng Pom/i approach 
to reading; matching books to students; the ddgn^du oi RdadLng Pou;e4 and 
the cloze technique; and implementing the Peg/Lee-6 RdacUng Pom/i. 

The appendix, Book Readability Measures, provides a reference to curriculum 
materials that have been analysed by the Peg/iee^ RdacUng Potjodn. system. 
Vdg/idd6 0^ Rdading Poujqa scores are presented for different sections of the 
materials and for the means of these scores. The subject areas covered 
consist of Language Arts and Literature, Science, and Social Studies. 

The Educational Products Information Exchange Institute has also developed 
two sets of modules for training teachers to select and effectively use 
curriculum materials. The first set to be developed, the Packaged Training 
Workshop in Instructional Materials Selection, consists of thirty modules 
developed during 1978-1979. The second set comprises ten modules developed 
during the conduct of the Teacher Information Exchange (TIE) project in 
1980-1982. 

The development, field-testing and revision of the Packaged Training Workshop 
in Instructional Materials Selection, funded by the National Institute of 
Education, are reported in the final report of the Educational Products 
Information Exchange Institute (1980). The thirty modules consist of three 
main groups: sixteen modules, the basic components of the set, developed, 
field- tested and revised during 1978-1979; four modules adapted from the 
first group for use with special educators, developed and later field-tested 
by the Wayne County Public Schools, Michigan during 1979; and ten modules 
developed during 1979 following empirical research conducted by the 
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Educational Products Information Exchange Institute to gather and analyse 
data that indicated widespread and gross misfitting of curriculum materials 
to the capabilities of students. A project to disseminate the modules 
and train teachers was initially conducted in Illinois during 1979 and 
later, in 1980, extended to other states. 

In 1980, the Teacher Information Exchange (TIE) project, reported in the 
Educational Products Information Exchange Institute (1986b), was implemented 
for two years in a dozen elementary and junior high schools in New York City. 
The Educational Products Information Exchange Institute's staff worked with 
teachers through classroom observations, consultations, workshops and 
meetings to identify issues related to the use of curriculum materials in 
classrooms. The same teachers were provided with inservice training about 
how to use curriculum materials more effectively once they had been 
selected. An important feature of this project was to train these teachers 
sufficiently so that they could share their training with other teachers. 
To facilitate teacher education, ten modules w^jre developed by the Educational 
Products Information Exchange Institute and field-tested in the participating 
schools. These modules addressed the following issues: 1. an overview 
of the concept of time-on-task; 2. and 3. educational objectives; 4. and 5. 
a management system involving tests and record-keeping devices; 6. and 7. 
supplementary materials, their adaptation, and planning of worksheets; 
8. classroom structure as related to using curriculum materials and learners' 
time-on-task; 9. pacing lessons; and 10. instituting routine in using 
instructional materials. 



As previously mentioned, the Educational Products Information Exchange 
Institute is currently developing a textbook utilisation policy. This 
policy, reported in the Educational Products Information Exchange Institute 
(1986c), is based upon three assumptions: firstly, that most textbooks are 
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inadequate to promote positive classroom instruction; secondly, that most 
supplementary materials are similarly flawed; and thirdly, that teachers 
require support, training, monitoring and communication with colleagues 
about using curriculum materials. The Educational Products Information 
Exchange Institute believes that publishers should be responsible for 
providing teacher education for users of their publications. Such teacher 
education programs should comprise an overview of the instructional program 
inherent in the curriculum material, a demonstration of how the curriculum 
materials should be used with learners, and provide discussion sessions with 
users after the demonstration. Furthermore, tnis initial teacher education 
program should be supported by evaluations of materials to establish their 
comprehensibility, readability and content appropriateness. Teachers should 
then be supplied with this information and trained to identify matching and 
mismatching of curriculum materials and the curriculum process in their 
particular contexts. Such a teacher education program should be spaced 
over a period of time and a planned model should be adopted. 

The conduct of both the Teacher Information Exchange (TIE) project and the 
development of the textbook utilisation policy indicates that greater 
importance and allocation of resources is being given by the Educational 
Products Information Exchange Institute to providing effective progams in 
teacher education. These teacher education programs have acted to extend 
the scope of the Educational Products Information Exchange Institute's 
activities in schools as well as to support their activities to protect 
the consumers of educational products. 

3.3 Centre for Educational Technology, University of Sussex 

Between 1973 and 1975, the Centre for Educational Technology, Sussex 
University, Falmer, Brighton, Sussex, England, conducted a project, funded 
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by the Volkswagen Foundation, dealing with' the evaluation of curriculum 
materials. The activities of the project, reported in Eraut ojt a£. , 
consisted of reading consultation at an international level and reflection, 
producing analyses of different materials, conducting an instructional 
program in curriculum analysis, and one-week workshops about the evaluation 
of curriculum materials. 

3.3.1 The Process for Selecting Curriculum Materials 

Unlike the instruments developed by the two previously mentioned institutions 
the process for selecting curriculum materials is an integral function 
of the instrument developed by this project group. Eraut qJl aZ. identified 
three essential functions of instruments used to evaluate curriculum 
materials: descriptive analysis; evaluation; and decision-making. The 
decision-making function, of relevance in this context, provides selection 
and implementation decisions to users of curriculum materials. 

They indicate that one of the major purposes of their instrument, the 
Sussex Scheme, is to provide selection evidence which will allow those 
considering purchase or use of curriculum materials to adopt, adapt or 
reject them. They argue that selectors should be presented with analyses 
of curriculum materials rather than being forced to decide upon the nature 
of the curriculum beforehand. Because selection is so closely linked to 
implementation, these writers believe that the last* optional section of 
their instrument. Decision Making in a Specific Contexts should only be 
completed by a member of the user group. 

3.3.2 The Evaluation Instrument 

Eraut QJ: at. indicate that they had had considerable experience in using 
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the CuMXcuZm MatoJUaJU^ AnaZy^^ Sy^tm developed by the Social Science 
Education Consortium to conduct analyses of curriculum materials, and had 
extended the application of this instrument to subjects other than social 
studies. Dissatisfaction with the Cu/uUcutum McutoAiaZ^ knaZy^Aj^ Sy^tm 
was partly responsible for their decision to develop their own instrument, 
termed the Sussex Scheme, which consists of five parts : 1. Introduction; 
Z. Description and Analysis of the Materials; 3. The Materials in Use; 
4, Evaluation; and 5. Decision Making in a Specific Context, an optional 
part. 

A characteristic feature of the Sussex Scheme is the authors' recommendation 
of a particular curriculum model without incorporating it within the 
instrument so that its use is not mandatory and can be substituted by other 
curriculum models. In this curriculum model the aims of a curriculum 
program or material are expressed in a curriculum strategy through four 
elements, none of which takes precedence, but operate through dynamic 
interaction: subject matter; objectives and outcomes; teaching, learning 
and communication methods; and assessment pattern. The authors argue 
that this allows a four-stage approach within parts 2 and 3 of the Sussex 
Scheme to be adopted. This allows for explicit and realistic relationships 
to occur between author, analyst and user. 
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This instrument also employs a separate evaluation section relating intents 
to differing standards and judgments so that the analyst is expected to 
express arguments both in support and in opposition to a curriculum program 
or material. Finally, the authors of the Sussex Scheme adopt both the 
selection and implementation decisions within the decision-making function 
so that users are presented with pertinent evaluations of curriculum 
materials rather than compelling them to select materials to fit a particular 
curriculum design chosen beforehand. 
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3.3.3 Applications to Teacher Education 



Important issues addressed in this project concerned curriculum analysis 
as a component of curriculum evaluation, within preservice and inservice 
teacher education, and curriculum criticism. An examination (.A the 
application of the curriculum analysis of materials within teacher 
education became a major portion within this project. 

The developers resolved the conflict between providing a corC.ent analysis 
approach through a subject-oriented course and a separate course in 
curriculum studies by supporting the need for integrative roles for 
curriculum analysis in preservice teacher education. They reject the 
former approach because, in all cases, it would lead to fragmentation 
of both the whole curriculum and the part-curriculum, and treat issues in 
isolation from one another. In seeking to avoid fragmentation, development 
of an independent course in curriculum studies is also rejected since it 
is viewed as likely to either degenerate to superficiality or elevate to 
meaningless theoretical considerations. 

On the other hand, they support developing an integrative focus through 
a multidisciplinary approach in which team teaching would be an important 
component. Three benefits of this approach are identified, and each is 
discussed as stated by the authors in relation to preservice teacher 
education. 

"Firstly it could serve a question-raising function. 
This could be especially valuable near the beginning 
of a course, perhaps immediately after a period of 
observation or teaching practice. It can certainly 
fulfil this role in inservice education, and we believe 
that with careful handling it could also do so in preservice 
education. The purpose would be to identify assumptions 
about subject matter, contingencies and goals, which 
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would subsequently be discussed in main subject and 
education courses. It could provide a practical base 
on which some of these courses could be built, thus 
adding a new dimension of relevance and commitment to 
more theoretical aspects of a student's work. 

In an exactly complementary fashion curriculum analysis 
could serve a unifying function towards the end of a 
course. If the earlier courses had dealt with the 
main forms of analysis, it could then concentrate on 
integrating the previous work and relating it to 
practical decision-making. To be successful, much 
more coordination of the curriculum would be needed 
than is commonly found at present; and it might need 
to be built into the assessment pattern if it was to 
be taken seriously at a late stage in the course. 
This could cause problems because we have found it an 
advantage to treat curriculum analysis as a small- 
group activity, and to use the resultant analyses as a 
basis for inter-group discussions. 

In both these roles curriculum analysis has been an 
integrative focus in an essentially mul tidiscipl inary 
approach to curriculum study; whereas in its third, 
and possibly most attractive, role it is a longer 
interdisciplinary course which, by use of team teaching, 
combines all the separate analytical approaches 
discussed above. This would certainly avoid 
superficiality, but would not necessarily avoid 
metatheory. The remedy in our view is to concentrate 
on curriculum criticism and to include its aesthetic 
as well as its functional aspects" (Eraut eX aJi. ^ 26-27). 



Eraut at. have transferred many of the assumptions underlying 
curriculum analysis for preservice teacher education to the inservice 
teacher education program offered at Sussex University. Curriculum 
analysis was applied initially to both short, one-week courses, and to 
post-graduate award courses as a means of preparing for topics in 
curriculum development where it was found useful in bridging its 
analytic and creative aspects. They state that: 




"One pattern we have evolved has much in common 
with some of our suggestions for pre-service 
education. We begin with a one waek workshop 
in which groups of students analyse materials 
specifically chosen for their significance and 

issue-raising potential This is followed 

by a series of interdisciplinary seminars during 
the term and concludes with each student producing 
an individual analysis for assessment 
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Now, however, we are experimenting with a new 
pattern in which an initial two-week workshop 
on the analysis of materials leads to an exploration 
of a part-curriculum in action. One seminar 
concentrates on curriculum issues in general 
while another seeks to provide methodological 
support for a brief empirical study. Two weeks 
are set aside for fieldwork, and the final 
analysis for assessment is expected to include 
both documentary and empirical evidence. There 
will be no attempt to engage in any formal 
measurement, and the empirical work will 
concentrate on observation and interviews. 
The purpose is to avoid an undue concentration 
on curriculum materials, to acquire a feel for 
non-quantitative empirical work and to encounter 
some of the problems of continuing documentary 
with empirical evidence" (Eraut e;t aZ. , 28). 



The authors establish the following goals for content analysis in 
inservice teacher education: to improve the implementation of new 
curriculum materials to improve existing curricula; to guide the 
selection of curriculum materials, as a preliminary to curriculum 
development; and the encouragement and facilitation of self-evaluation. 
Additionally, Eraut zt at. indicate specific objectives for the one week 
residential workshops. Minimum objectives would include developing a 
greater understanding of some curriculum materials being used in 
participants' schools; the ability to complete an analysis; and the 
ability to understand and use the Sussex Scheme. Beyond these minimal 
objectives, the authors intend that participants acquire a positive 
attitude toward curriculum analysis; increase their understanding of 
curriculum problems; develop their self-evaluative skills, and form 
relationships with other participants likely to be of value. 



These workshops of teachers, advisers and lecturers were recruited 
through professional networks and selective invitations so that 20 to 30 
people, later subdivided into 4 to 7 groups of 6 to 2 participants each, 
formed each class. An important characteristic of participants in these 
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classes was the range of subject expertise, and different groups within 
each class analysed different curriculum materials. 



Considerable preliminary activities on the part of workshop organisers and 
participants occurred. Participants were circulated with a short paper, 
'Aims for Curriculum Analysis Workshops', The Introduction and Guide to the 
Sussex Scheme, The Sussex Scheme, a sample analysis, a timetable for the 
workshop, and a list of participants. Participants were also advised to 
familiarise themselves with the curriculum materials they intended to 
analyse. 

The authors believed that the workshop timetable should be flexible although 
it should include three plenary sessions: an introductory session when 
attention is given to the aims of curriculum analysis; a final-day session 
for groups to report their activities; and an evaluation session in which 
the instrument and the teacher education program are discussed. The 
methodology adopted during the one-week workshops was directed to the 
Sussex Scheme providing the essential structure for the course. The role 
of the course leader was confined to that of a facilitator concentrating 
upon the development of understanding of the Sussex Scheme, the dynamics 
of group interactions and production of analyses. 

The authors' analysis of the outcomes of the one-week workshops suggested 
that all objectives of the course were satisfied although there was some 
disappointment with the development of the analyses of curriculum materials. 
However, a major improvement occurred within the process objectives. 

3.4 Other Sources 

As reported, projects intended to improve the selection and the evaluation 
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of-*cttn*i*cul-um -ma teri a^I s-through~teaeher~eduedfe4ei^-^f^-f^^ ; -eus-r 

Documents, identified during the course of the ERIC search ^.-^ ohe Rq^ouacq^ 
in EducatLon database are listed in part 2 of Appendix 2. A critique of 
each of those documents, judged to be instructional modules, will be provided 
in the following section of this chapter. In this section, the documents 
have been classified as either relating to a general treatment of the topic 
or relating to bilingual-bicultural education, multicultural education and 
related areas. 

The remaining documents listed in part 2 of Appendix 2 were excluded 
because they were judged not to be instructional modules. These documents 
have also been classified as either one of the two types of research, and 
abstracts of each are included in the introductions to these subsections. 

3.4.1 General Treatment 

Wentling and Piland (1982), ED 225 025, have developed a non-classroom 
guide to assist the person, probably a librarian or a media specialist, 
to lead personnel of a local education agency in evaluating both print 
and audio-visual materials. The activity is presented in three parts: 
firstly, the conduct of an inventory of instructional materials owned by 
the local education agency; secondly, an assessment of the adequacy of the 
materials; and thirdly, the use of results from both the inventory and 
the assessment. The guide is divided into three sections. The first 
section describes the steps, including a staff meeting, necessary to 
prepare for the activity. The second section outlines suggested tasks 
for conducting the activity. The third .section contains supporting 
documents to the guide. 
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3.4:1.1 • Special Educattor i S u per vi <;o r T rai n ing P rojec tv The University 
of Texas at Austin 



De Luca (1975), ED 120 986, is one of a series of ten self-study teacher 
training modules, each dealing with critical skills for supervisory teachers 
in schools. The materials were developed for Iccal professional 
development programs to supplement formal training and field experiences. 

The purpose of the module about materials selection is to provide 
supervisors with skills to develop a set of criteria for evaluating 
instructional materials and for conducting selection committee sessions. 
Participants are required to engage in an assignment divided into two parts 
and to evaluate their performance through a self-evaluation checklist and 
a post- test. Students can also optionally administer the post- test as a 
pre-test to measure their level of competence. Those students who 
successfully answer fewer than 75% of the items should continue the course. 

Participants commence the course by reading the sections. Description of 
the Situation and Task Assignment, then Contents of a Selection Tool and 
scanning the section, Sources of Media Information (Selection Tools). 
They must also read the sections. Development of a Selection Procedure, 
and Controversial Areas in Library Materials before commencing the task 
assignment. 

The task assignment includes a description of a role-playing situation 
and the assignment is divided into two parts. Firstly, students must 
develop a material's selection policy which includes a method for 
assessing cost based upon the potential usage, timeliness and durability 
of materials, a review of current materials, develop the use of field- 
tests, and ways of handling controversial issues. Secondly, they must 

develop a procedure for selecting instructional materials including 
Q . . .62 
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developing and applying a selection instrument; they must receive and act 
upon suggestions for materials' acquistion; they must be able to judge the 
intervals at which selection should occur; they must devise the means for 
conducting materials' selection, including the membership of selection 
committees and devising procedures to be used in receiving gifts and 
donations to a library. 

Once the task assignment has been undertaken, the student should complete 
the self-evaluation checklist followed by the post- test. Students failing 
to answer 75% of the items correctly should reread the module. 

3.4.1.2 The Center for Vocational Education, The Ohio State University 

The Center for Vocational Education (1977), ED 149 063, is the fifth of 
six modules about instructional planning within a series of 100 performance- 
based teacher education modules. Materials within this series are 
designed for either self-study or group instruction within a professional 
development program under the direction of teacher educators acting as 
resource persons. 

The module consists of three learning experiences. In the Overview to 

Learning Experience I, the developer provides statements about an enabling- 

objective, five activities, two of which are optional, and feedback. 

The enabling objective states that students are to demonstrate knowledge 

about important considerations involved in selecting instructional materials. 

Students cormence the learning activity by completing five activities. 

The first activity involves reading an extract from a reference book. 

The second activity involves reading an information sheet, then selecting 

and obtaining instructional materials. The third activity, which is 

optional, requires students to apply the Flesch readability formula to a 

sample text. The fourth activity, which is also optional, involves 
Q . . .63 

^ 78 



identifying current instructional materials, that are used locally, by 
contacting appropriate resource personnel. The fifth activity requires 
students to demonstrate their knowledge of important considerations involved 
in selecting and obtaining instructional materials by completing a 
checklist called a Self-check. The feedback requires students to compare 
their completed self-check against model answers. 

In the Overview to Learning Experience II, the developer provides statements 
about an enabling objective, two activities and feedback. The enabling 
objective states that the student is to critique the performance of the 
teacher described in the Case Study. The feedback requires the students 
to evaluate their competencies by critiquing the teacher's performance in 
selecting and obtaining instructional materials. This is accomplished by 
the students comparing their completed critiques against the Model Critique 
provided in the module. 

In the Overview to Learning Experience III, the developer provides 
statements about a terminal objective, an activity and feedback. * The 
terminal objective requires the participant to select instructional materials 
whilst working in an actual school situation. The activity requires that 
the participant select instructional materials for a single lesson. 
The participant should take into account all factors governing the 
selection of instructional materials, search available sources, evaluate 
potential materials, list selections, and obtain selected materials. 
Feedback involves the resource person, such as the librarian, assessing 
the participant's performance in the activity by using the Teacher 
Performance Assessment Form. 
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3.4.1.3 Northern minois University, De Kalb, Illinois and Region 
I Adult Education Service Center, Chicago, Illinois 

The series of modules developed by Charuhas (1984), ED 256 913, consists 
of an introduction, twelve modules and three appendices aimed at helping 
teachers and administrators select and evaluate curriculum materials 
that are appropriate to their educational programs. The series of 
modules is designed for either self-study or use within a teacher 
education program. 

In the Introduction, the author provides the rationale for developing this 
series of modules and presents a model illustrating three key issues 
affecting the selection and the evaluation of curriculum materials. 
This discussion is imbedded within an introductory statement about the 
modules. 

Most of the modules are divided into four major sections: a statement 
about the objective of the module; a set of one or more activities; 
suggestions for the reader; and a list of references. 

The first four modules are concerned with antecedent conditions that 
affect the teaching-learning process. The objective of Module 1, 
titled The Adult as Learner, is for participants to be able to identify 
forces — the differing backgrounds of adult learners in their classes 
and their students' purposes for participating in further study — 
affecting adult learners. There are three activities included in this 
module: in the first activity, participants can either develop a student 
information sheet or an exercise to elicit background information from 
students; in the second activity, participants are to plot a chart to 
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indicate the composition of the class; and the third activity, participants 
are to prepare a summary of the information compiled in the chart. lie 
objective of Module 2, Teaching Styles, is to enable participants to assess 
their own teaching style in terms of whether it is sufficiently flexible 
to cater for both materials designed for teacher-directed instruction and 
materials designed for individualised instruction. The module contains 
two activities: firstly, a survey to evaluate teaching styles; and secondly, 
provision for students to summarise the characteristics of their teaching 
style from information provided by the survey. The objective of Module 3, 
Teacher Strengths, is to present participants with the means to assess their 
own areas of expertise. Participants undertake two activities — 
summarising their own self-assessments, and listing methods to overcome 
their own weaknesses — following completion of a self-assessment inventory. 
The objective of Module 4, Learning Styles, is to enable participants to 
identify the components of learning style and relate them to classroom 
management. The module contains two activities: firstly, a questionnaire 
designed to determine participants own learning styles; and secondly, 
provision for participants to summarise characteristics of their own 
learning style. 

Module 5 through to Module 9 focus upon major features of the evaluation 
of curriculum materials. Module 5, Textbook Organization, has the objective 
of enabling participants to identify major features of textbook organisation. 
In the only activity, participants are required to rank, in order of 
importance, such textbook organisers as the table of contents, the chapter 
headings, the lesson headings, pre-tests, post-tests, unit tests, the 
objectives, the index, the glossary, answer keys and progress chart for 
one subject area. The objective of Module 6, Orientation of Material, 
is to enable participants to determine if curriculum materials are skill- 
oriented or content-oriented. In the activity, participants must select 
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materials that are either content-oriented or ski 11 -oriented and determine 
how the characteristics of class activities, instructional exercises and 
question types of the type of material chosen differ from the other type. 
Module 7, Diagnosis, Reinforcement, Evaluation and Assessment, has the 
objective of enabling participants to identify the roles that diagnosis 
(pre-tests), reinforcement (practice exercises), evaluation (post-test or 
unit-test) and assessment (feedback to students in the form of scores 
and reports), play in a text. This module contains two activities: 
firstly, participants are required to identify examples of each type of 
material; and secondly, in designing a textbook, participants are required 
to determine and allocate portions of the text they are designing to 
emphases upon instructional design, diagnosis and orientation. Module 8, 
Adult Tone, has the objective of enabling participants to identify the 
factors involved in determining the audience for curriculum materials and 
biases that they may contain. This module contains two activities: 
participants are required, firstly, to evaluate four brief passages for 
bias; and secondly, to evaluate the 'tone' of a set of diagrams. The 
objective of Module 9, Format and Appearance, is to present participants 
with the means to identify and evaluate the format and appearance of 
curriculum materials. In the first of twa activities, participants are 
required to determine the technical appropriateness of three materials 
they use. In the second activity, students are required to evaluate a 
set of layouts. 

Module 10 examines the use of readability formulas in order to match the 
level of difficulty for reading of curriculum materials to students' 
reading abilities. The Dale-Chall, Spache and Fry formulas, Gunning-Fox 
index and cloze method are considered. This module contains two activities: 
firstly, participants complete a cloze exercise; and secondly, they measure 
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the readability level of the same passage using both the Fry and Gunning- 
Fog formulas. 

The remaining two modules are concerned with fittings curriculum materials 
to particular aspects of educational programs. The objective of Module 
11, Supplemental Lessons, is to enable participants to plan their own 
supplemental lessons. The activity in this module requires the participants 
to develop a lesson plan. Module 12, Program Constraints, has the 
objective of enabling participants to identify the constraints upon 
educational programs — class schedule, budgetting, purpose, and 
community resources which affect the selection of curriculum materials. 
This' module contains two activities: firstly, students must apply a 'set of 
criteria to develop a profile of an educational program; and secondly,, 
they must select materials for an educational program, taking into account 
the constraints identified. 

Three appendices are attached to this document: a simulation game; a 
suggested outline for a materials evaluation workshop; and a materials 
evaluation checklist. The second appendix is considered here because 
of its relevance. The plan adopted for the materials evaluation 
workshop incorporates content extracted from each of the modules within 
the main section of the document. A final section within this appendix 
recommends applying 'hands-on' evaluation of curriculum materials through 
small groups, developing criteria for evaluating materials through 
consensus, and evaluating the training sequences through discussion and 
writing. 

3.4.2 Bilingual-bicul tural Education, Multicultural Education and 
Related Areas 
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Banks (1974), ED 090 307, repor.-; an experimental research design to test 
whether teachers who had hf-isr trained lo evaluate curriculum materials for 
possible racial bias, would nave become more aware of the need to evaluate 
textbooks for bias and w",.kl be able to perform the evaluations more 
effectively within their school districts. Teach-, rs of the first through 
third grades were trained by means .. r Conttyvt Analy^ii TtUbook^ ion. 
Black Stadznti, Grades 1-3 - f-instructic lal program developed by the 
Far West Laboratory for Educuuonal Research and Development. 

Rabin (1978), ED 172 163, reports an experimental design, of an action 
research type, to compare two approaches to inservice programming in staff 
development: an inservice workshop using independent materials; and the 
same workshop using materials followed by individualised assistance. The 
problem addressed concerned the selection and use of appropriate reading 
materials by content area teachers. The results of the study showed that 
those teachers who received individualised assistance felt more competent 
although there was little change in behaviour between teachers in the two 
groups. 

3.4.2.1 Teacher Corps Bilingual Project, University of Hartford, Hartford, 
Connecti cutt 

The module developed by Hernandez and Melnick (n.d.), ED 095 141, consists 
of a pre-test, two learning activities and a post-test. It is designed 
for providing participants in a teacher corps bilingual project at the 
University of Hartford with guidelines for evaluating and adapting written 
materials for English-as-a-second-language classes. The module is designed 
for classroom use. 
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The objective of the learning unit is to evaluate any written material 
for relevance, con'/jnt and achievement of the teaching aims. The pre-test, 
termed pre-assessment, is designed to measure mastery of the objective by 
requiring participants to prepare an evaluation of a material based upon 
specific criteria about the relevance, the content and the achievement of 
teaching aims. 

The first learning activity requires the participants to choose one of 
four learning alternatives. Each of the learning al terniitives requires 
the participants to evaluate part of a textbook. The first two alternatives 
require the participants to read extracts from texts current at the time of 
the module's publication; the thi d alternative requires the participants 
to evaluate one of four types of textbooks in terms of its promotion of the 
achievement of teaching aims by applying an appropriate set of criteria; 
and the fourth alternative requires the participants to prepare an evaluation 
of a material based upon an interview with a teacher. 

The second learning activity requires the participants to select one of five 
learning activities. Again, the first three alternatives are reading 
activities followed by evaluation activities applying techniques derived 
from the readings; whilst the fourth alternative requires the participants 
to design their own learning activities; and the fifth alternative requires 
participants to attend a scheduled seminar. 

The contents of the post-test are identical to the pre-test. Competency 
is assessed by the module coordinator, and participants requiring remediation, 
contract to undertake alternative learning activities with their 
coordinator. 
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3.4.2.2 Far West Laboratory for Educational Research and Development, 
San Francisco, California 

The module designed by the Far West Laboratory for Educational Research 
and Development (1977), ED 177 048, consists of three lessons intended to 
enable teachers to select literature with a multicultural perspective. 
The module is designed for either self-instruction or class use. 

Statements of objectives introduce the preliminary lesson. The objectives 
state that the participants should understand the importance of judging 
books for their inclusion of minority cultural experiences; that the 
participants should be sensitive to the importance of including, in 
classroom materials, portrayals of people that are relevant to their 
experiences and cultures; and that the participants should develop the 
skills of analysing the illustrations and written content of children's 
books in terms of the perspective of a particular culture. 

In Lesson One, titled Illustrations reflecting People of a Particular 
Culture, the participants read the lesson in the module. This inclides 
a passage followed by a set of criteria used to identify biassed 
stereotyping in books. Knowledge of these criteria is then applied by the 
participants to two exercises: in the first. Analysing Illustrations, 
the participants are expected to analyse a book for inclusion of representati\ 
characterisations of people of a particular culture; in the second. 
Diversity in Book Illustrations, an individual or group exercise, 
participants select books that illustrate differences between the experiences 
of people of a particular culture and are free of stereotypes. This is 
followed by a brief Follow-up Discussion relating to the second exercise. 
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In Lesson Two, titled The Multicultural Experience: A Unique Reality, 
participants participate as a group in eight experiences designed to 
provide information for analysing the written content of children's books 
illustrating a black perspective. In the first experience, What do You 
See and Why?, participants view a pair of facial images in the module, 
respond to these images and compare their perspectives of the images. 
In the third experience. Using Cultural Categories to Classify Examples of 
Similarities and Differences of Personal Experiences, participants complete 
a cultural matrix. , In the fourth experience. Ethnic Group Realities, 
the participants examine and comment about a cartoon featured at the 
commencement of the lesson. In the fifth experience, discovering the 
Black Perspective, the participants read an article, 'Black Perspective 
in Children's Books', appended to the module and then take part in a group 
discussion to clarify the contents of the article. In the sixth experience. 
Analysing the Written Content of Children's Books using a Black Perspective, 
the participants complete twc assignments: firstly^ the written content 
analysis instrument, level 1; and secondly, a book entry sheet. In the 
seventh experience. Evaluation Guide, the participants check their 
application of the written content ana Js instrument in the first 
assignment.' In the eighth experience. On Your Own, the participants apply 
the written content analysis instrument to evaluate a mul ticul tjril textbook. 

Two appendices are attached to the module: the first is titled. Black 
Perspective in Books for Children; and the second is titled. Developer's 
Analysis of 'Evan's Corner'. 'Evan's Corner' is a literary extract 
analysed by the participants during the course of their study of the module. 

3.4.2.3 Ohio Department of Education, Columbus, Ohio 
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Eberhardt and Lloyd (1975), ED 106 753. is the first of a series of nine 
modules, or individualised inservice packets, about reading procedures 
that can be implemented in all subjvicts in the elementary, middle and 
secondary levels of schooling. Each of the modules is designed for 
self-instructional use. 

The module, Ai^di^mant P^nt MouteAlati , consists of five sections: 
Assessment of Student Reading Competency; Readability Level of Print 
Materials; Assessment of Problems within the Selected Content; Adaptation 
of Content; and Evaluation of Basic Text. An Introduction contains a 
statement of the three-fold goal of the module. Each section, designed 
in a similar format, contains a statement of the section's objective, a 
content abstract, and an application of the participant's performance 
through a set of exercises. A self-corrective post-test constitutes a 
final section to the module. 

The three-fold goal, presented in the Introduction, directs the participant, 
firstly, to assess student reading competency; secondly, to determine the 
readability level of a material; and thirdly, to adapt materials, Ing 
students to master the vocabulary and concepts. 

The objective of the first section is to enable the participant to assess 
the reading competence and interests of individual students. The Content 
Abstract informs the participant about two techniques for assessing students' 
reading competencies: by using norm-referenced achievement tests to 
measure a group's performance; and by applying diagnostic techniques to 
measur« the performance of underachieving students. The Content Abstract 
also contains suggested ways to sample students' reading interests: 
questionnaires; observations; interest surveys; and identification instruments 
.The exercises presented in the Application relate to performing each of 
these skills. 
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The objective of the second section is to enable the participant to 
determine the readability levels of print materials. The Content Abstract 
describes how the Fry Readability Formula can be applied to analysing 
readability levels of print materials. The Application requires the 
participant to use the Fry Readability Formula to analys three passages. 

The objective of the third section is to enable the participant to analyse 
readability factors which will affect reading difficulty. The Content 
Abstract informs the participant about how to identify these particular 
types of factors — - vocabulary, and levels of abstraction. .The Applicatior 
requires the participant to analyse components that make a sample passage 
easy or difficult to understand. 

The objective of the fourth section is to enable the participant to adapt 
content of reading material so that it is appropriate to the varied levels 
of students* reading abilities. The Content Abstract contains a set of 
guidelines for assessing v;hether reading materials require adaptation. 
The Application requires the participant to adapt a written passage so 
as to render it both simpler and more challenging. 

The objective of the fifth section is to enable the participant to apply 
a standardised instrument to evaluate a print material. Such an evaluation 
is then to be used as a basis for selecting materials by applying two 
criteria: that the content of the material must relate to the particular 
area of the curriculum; and that the material must be suitable to the 
reading achiv-vement levels of the particular students. Criteria for 
evaluating four types of print materials are listed in the Content Abstract: 
total series; student materials; teacher's edition; and supplementary 
materials... The Application requires the participant to use the Evaluation 
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Guideline to assess a textbook, teacher's manual and a supplementary 
material . 

The Self-corrective Post Test requires the participant to apply aspects 
of what have been learnt. By selecting a random sample of ten students 
from a class the participant teaches, he or she plots their reading 
expectancy levels against reading achievement test scores. These scores 
are then used to identify the students' frustration, instructional and 
independent reading levels. 

3.5 Conclusion 

The examination of the sources for materials to train teachers to select 
and evaluate curriculum naterials indicates that these developments have not 
been extensive. The outcome of this ex^iination, to the extent that it 
relates to bil ingual-bicultural education and multicultural education, is 
presented in this chapter. 

Teacher education has played a significant function in each of the three 
institutions examined. The Social Science Education Consortium has applied 
its CiUiAlauZm MateAiat!) AaoZij^aj, Sy.i>tm to teacher training. The 
Educational Products Information Exchange Institute has developed, several 
sets of teacher education materials in an endeavour to train teachers to 
conduct evaluations of education^il materials specifically for EPIE Reports 
and, more generally, to educate teachers to become more competent in their 
selections of curriculum materials for classroom use. The project fostered 
by the Centre for Educac.o,.al Technology, University of Sussex, has made a 
valuable contribution to theoretical imol ications for teacher education on the 
selection and evaluation of curriculum materials. 
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The literature in this field, presented in Chapter 2, showed that the trend 
in the analysis of curriculum materials has been concentrated in three main 
spheres: the application of instruments that provide, to a greater or lesser 
extent, the capabilities for descriptive analysis, evaluation and decision- 
making functions; the application of objective measures to evaluate bias; 
and the application of measures to match the readability levels of curriculum 
materials to students' reading levels. This situation has been substantiated 
by the review of institutional activities presented in Chapter 3. 

Developments in teacher education to improve the quality of selecting and 
evaluating curriculum materials, however, have not maintained pace with the 
spheres identified above. The examination of developments in teacher 
education, from both the selected institutions and from other sources, has 
shown that most attention has been given to providing training in the use of 
instruments that evaluate curriculum materials. More recently, some attentioi 
has been given to providing teacher education to match readability levels of 
curriculum materials to students' reading levels. This attention, however, 
is still rudimentary; the investigation of these techniques to match bilingual- 
bicuUural materials to students' reading levels in their second language, 
together with consequent aspects of teacher education, warrants research. 
On the other hand, there has been little attention given to training teachers 
in techniques to recognise and evaluate biases in curriculum materials. 
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4. THE PROPOSAL FOR A TEACHER DEVELOPMENT PROGRAM 



4.1 Introduction 

Two fundamental and contrasting views of curriculum development are 
indicated in the literature: the objectives model; and approaches that are 
opposed to the objectives model (Stenhouse, 1975; Lawton et a£. , 1978; 
Brady, 1983). To clarify discussion about the planning of this teacher 
development program, each of these views is briefly discussed below. 

The objectives model has*' been of foremost importance to curriculum development 
since Tyler (1949) provided its first systematic acco" it. The objectives 
model presumes four broad principles: stating objectives; selecting 
learning experiences; organising learning experiences; and evaluation. 
The initial stage, stating objectives, from which the process of systematic 
curriculum development occurs, received detailed attention in a taxonomy 
of objectives for the cognitive domain (Bloom zt aZ.^ 1956), and a taxonomy 
.of objectives for the affective domain (Krathwohl a£. , 1964). In contrast 
to this refinement of objectives, Taba (1962) provided the principal statement 
relating these principles to the practice of curriculum development. 
Taba enunciated eight sequential steps: diagnosing needs; formulating 
objectives; selecting content; organising content; selecting learning 
experiences; organising learning experiences; evaluating; and checking 
for balance and sequence. 

Whereas, the specification of objectives is emphasised in the objectives 
model, the sequential ordering of steps in curriculum planning is not 
recognised in the other approaches. Two main approaches might be said 
^r. T^p'^-^rt this principle: the process model; and the interaction model. 
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Advocates of the process model stress that there should be no initial 
statement about objectives; greater emphasis should be placed upon 
methodology than content; both content and methodology are intrinsically 
valuable; and that evaluation should serve as a means of establishing 
the worth of outcomes rather than measuring prespecified objectives. 
Peters (1966), first suggested the foundations for the process model, by 
insisting that areas of knowledge in curriculum activities are intrinsic 
parts of the curriculum rather than means to ends as they are treated in the 
objectives model.. Stenhouse stressed that the process model is more 
appropriate to curricular areas which centre on knowledge and understanding 
whilst, at the same time, insisting that the objectives model is more 
appropriate to areas which emphasise information and skills. 

In the process model, it is presumed that a series of significant questions 
about a course must be discerned and answered as it progresses. Stenhouse 
has provided principles upon which such questions should be established: 
four principles of planning which comprise selection of content, development 
of a teaching strategy, decisions about sequence, and diagnosis of student 
strengths and weaknesses, including applying the threa preceding principles 
to individual cases; four principles of empirical study which comprise study 

7 

of student progress, study of teacher progress, establishing the feasibility 
of implementing the curriculum in different school contexts, pupil contexts, 
em/ironments and peer group situations, and providing information and 
explanation about the variability of effects in differing contexts and on 
different students; and one principle related to justification, the formulation 
of the intention or aim of the curriculum which is open to scrutiny. 

Unlike the objectives model, the interaction. model does not presuppose 

a sequence between the different elements of the curriculum. 

Br?.dy (1983) contrasts the interaction model with the objectives model. 

Whereas the sequential ordering of the elements of the curriculum are presumed 
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within the objectives model, the curriculum is viewed in the interaction 
model as a dynamic process between the elements, in which no element 
predominates. It is assumed, however, that changes to one curriculum 
element will affect the other elements. Curriculum development can 
commence with any one of the four curriculum elements, and curriculum 
developers are not restricted in when and how they develop or modify the 
elements. 

In conclusion, it should now be evident that each of these models for 
curriculum development has both strengths and weaknesses. The s ' engths 
of the objectives model are generally the weaknesses of the alternative 
approaches and weaknesses of the objectives model are generally the strengths 
of the alternative approaches. In accepting Stenhouse's pronouncement 
that the respective emphases placed upon either knowledge and understanding 
or information and skills should constitute the criterion for selecting and 
adopting a particular model of curriculum development, the author has 
selected and adopted the objectives model. The emphasis of this teacher 
education program is placed upon the development of skills, and imparting 
knowledge ' subordinate. Despite this decision, account will be taken 
of the strengths of the alternative approaches in developing the constructs 
of the program. 

As the foremost exposition of the objectives model in terms of the practice 
of curriculum development, Taba's eight steps will be adhered to in developin 
the teacher education program. Pratt (1980) has refined these steps 
within the wider scope of curriculum development and implementation, and 
these refinements will be incorporated within the ensuing discussion. 
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4.2 Preliminary Steps 



4.2.1 Needs Assessment 

Taba's first step, which Pratt describes as a preliminary step to curriculum 
development, is needs assessment. Needs assessment refers to a set of 
procedures to identify and validate needs, establish priorities among them 
and promote effective public relations. Needs assessments originated during 
the mid-1960' s in the United States of America, when federal education 
autiiorities required state education departments and school districts to 
undertake comprehensive assessments to justify fundings. 

The policies and practices for selecting and evaluating curriculum materials 
have been inadequately addressed through needs assessments. A survey of the 
documents entered into the databases of the Educational Resources Information 
Center, and listed in Appendix 2 and Appendix 3, indicates that four documents 
annotated in the Ke^ouAceJi In EduacutLon database, and one article annotated 
in the CuAAZYvt Indzx to JouAnal6 In Education database, have discussed needs 
assessment. The authors of these documents are the Institute of Educational 
Development (1969), ED 044 030, Kamhi (1982), ED 208 885 and ED 210 772, and 
the California State Department of Education (1984), I'D 256 748, annotated in 
in the Re^ouAce^ In EduacutLon database, and Talmage (1981), EJ 241 804, 
annotated in .the CuAAo.nt Index to JouAnaLs In EducaXA^on database. No 
documents that apply needs assessment to selecting and evaluating curriculum 
materials were located in either the Au^tAoLian Education Index or the 
BAtti^h Education Index. 

The author conducted a survey of opinions held by twelve coordinators of 
courses conducted by the Centre for Continuing Education of Teachers in 
order to identify the need for teacher education to improve the quality of 
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the selection and the evaluation of curriculum materials. These courses 
were chosen because they contained subject matter that related directly to 
selecting and evaluating curriculum materials, or included subject matter 
related to bil ingual-bicul tural education or multicultural education. The 
subjects were Computers in Education, Early Childhood Education, Educational 
Media, Language Development and Multicultural Education, Literature for 
Children, and School and Classroom-based Curriculum Development. 

The survey was intended to identify three characteristics about the attitudes 
of conrsc coordinators to teacher education for improving the quality of the 
se^ ction and the evaluation of curriculum materials. The following terms 
ven to the three characteristics on the questionnaire: knowledge and 
' -;s (which were intended to identify the need for teachers to possess the 
knuwiedne and the skills to select and evaluate curriculum materials); choice 
cf course design (which was intended to identify the most appropriate way 
to provide such knowledge and skills within the program offered by the Centre 
for Continuing Education of Teachers); and the form that curriculum 
development should take in the program of the Centre for Continuing Education 
of Teachers to successfully meet the needs of teachers. An analysis of the 
results of the survey is presented in Appendix 8. 

A statistical analysis of this, data was not attempted because only six 
subjects responded to the survey. Opinions expressed by the respondents, 
however, indicated that: 

1. they agreed that teachers required the knowledge and the skills to 
select curriclum materials; 

2. they agreed that a subject-oriented course design was the most 
appropriate way to present such knowledge and skills; 

3. they were generally uncertain about, or felt the course content 
presented in Appendix 7 did not hiatch their expectations of teachers* 
requirements; 
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4. they were uncertain about supporting the development of a general 
program to treat the knowledge, the skills, the attitudes and the 
values involved in selecting and evaluating curriculum materials; and 

5. in all cases, they stated that they included subject matter in their 
courses that related to the selection and the evaluation of curriculum 
materials. 

This survey was not intended to fulfil, nor did it accomplish, the requirements 
of a needs assessment. The survey was only intended to provide an 
indication about attitudes of coordinators towards introducing different 
types of teacher education programs for selecting and evaluating curriculum 
materials. It was only partly successful in satisfying this intention, 
as no attempt was made to survey the course coordinators about the range of 
options discussed in Chapter 5. 

4.2.2 Antecedent Conditions 

Pratt insists that curriculum developers should pay heed to a number of 
issues which are sometimes termed in the literature, 'front-end analysis'. 
Essentially, front-end analysis involves a process of analysing antecedent 
conditions and making crucial decisions about a proposal for curriculum 
development on the basis of such analyses. 

Pratt specifies a series of analyses of antecedent conditions: assessing 
students' performances about the particular content area to judge whether 
an identified need is being currently met; considering alternatives to 
curriculum development; considering curriculum parameters — institutional 
context, target population, time and cost, resources, and identifying 
constraints (those relating to learners, political considerations, educational 
policies and internal institutional factors). 
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No instances were identified in the literature search where antecedent 
conditions, for developing and implementing a teacher education program to 
improve the quality of the selection and the evaluation of curriculum 
materials, were analysed. Furthermore, few resources were identified upon 
which analyses of antecedent conditions could draw. The search of the 
databases of the Educational Resources Information Center identified a single 
instrument, that developed by Willis (1976), ED 125 654, to assess students. 

A second major set of issues at this stage of curriculum development involves 
establishing a suitable curriculum development team and scheduling the project. 
It is apparent that for the six documents identified in the Rn^ouAc^^ 
In EducatLon database, curriculum development teams were formed in four 
cases (De Luca, The Center for Vocational Education, Charuhas, and the Far 
West Laboratory for Educational Research and Development). Although, in 
each case, staff of the respective institutions formed the bases of the 
curriculum development teams, the scope and degree of involvement of other 
personnel varied considerably. Only in the case of the development of the 
series of modules for teacher education at The Ohio State University, were 
personnel, numbering several thousand, involved from other tertiary 
institutions and schools. 

4.3 The Constructs of the Curriculum 

4.3.1 Formulating Objectives 

Taba believed that the needs assessment applied to a curriculum issue will 
help to direct the developer to those objectives that need to be emphasised. 
Furthermore, the analysis of the antecedent conditions will also assist the 
developer's specification of objectives. Taba stated that these objectives 
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should encompass statements about concepts or ideas to be learned; attitudes 
and values to be developed; ways of thinking to be reinforced, strengthened 
or initiated; and habits and skills to be mastered. 

The purpose of this teacher education program is to provide bilingual - 
bicultural and multicultural educators with the knowledge and skills necessary 
to select, to adopt and to analyse curriculum materials that are appropriate 
to the needs of particular ethnic and linguistic groups. Hie goal of this 
program is to provide the knowledge and skills that are essential for this 
purpose: an understanding about the critical problems associated with 
bilingual-bicultural and multicultural cur^^iculum materials and the skills to 
analyse these problems; an understanding of producers* responsibli ties to 
validate their products and the skills to evaluate the extent of producers* 
validation activities; an understanding of the types of personnel and 
techniques to be used to select, adopt and utilise curriculum materials and 
the skills to assist in participating in selection, adoption and utilisation 
procedures; and an understanding of the application of Tyler*s objectives 
model to the analysis of curriculum materials and the skills necessary to 
conduct analyses of curriculum materials. 

This program has been developed as a component of a broader, mul tidiscipl inary 
teacher education program that has the aim of providing knowledge and skills 
for teachers and other professional educators to select, adopt and analyse 
curriculum materials. The goal of the program is encompassed in four topics, 
the first of which is directed to a group of bilingual-bicultural and 
multicultural educators in a workshop, v/hilst the remaining topics are directed 
to the class group in a workshop. The order of the topics presented in the 
program is not intended to determine the sequence of their presentation in a 
workshop. Ihe topics, which are intended to be presented through introductory; 
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discussion and demonstration followed by student performance through analysis, 
generalisation and application, address: firstly, the characteristics of 
bilingual-bicultural and multicultural curriculum materials; secondly, the 
assessment of producers* validation activities; thirdly, the selection, the 
adoption and the utilisation of curriculum materials; and finally, the 
evaluation of curriculum materials. 

The objectives of each topic are: 

1. to understand and learn the explicit concepts, defined in each topic, 
that are necessary to perform tasks associated with the processes of 
analysis, generalisation and application; 

2. to apply these concepts to the analysis of curriculum materials; 

3. to apply these concepts to generalise conclusions through comparative 
analysis of curriculum materials in different situations; and 

4. to apply these concepts to the analysis of curriculum materials 
within the educational context of a workplace. 

4.3.2 Selecting Content 

In selecting content, Taba specified three subordinate steps: selecting topics; 
selecting basic ideas; and selecting specific content. Taba also specified 
criteria for determining the structure of each of the subordinate steps: 
the significance and validity of the content; learnability and appropriateness 
to learners* needs and developmental levels. 

In fulfilling the requirements of Taba's subordinate . teps, the contents of 
this teacher education program were selected to meet the specified 
educational objectives on the basis of two criteria. Firstly, the contents 
of the teacher education materials described in Chapter 3 were examined. 
Through reaching a decision about what the developers of these materials 
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viewed to be the critically important knowledge, skills, attitudes and values 
to be imparted, the author selected and included such features within this 
teacher education pv-ogram. Secondly, what the author considered to be 
significant knowledge, skills, attitudes and values also guided the selection 
and inclusion of such content within the teacher education program. 

The topics addressed in each of the teacher education modules are now 
described briefly. The contents of the modules developed by the Special 
Education Supervisor Training Project at The University of Texas at Austin 
(De Luca) and The Center for Vocational Education at The Ohio State University 
are directed to selecting curriculum materials, whilst the contents of the 
modules developed by the Teacher Corps Bilingual Project at the University of 
Hartford, Hartford, Connecticutt (Hernandez and Melnick), the Far West 
Laboratory for Educational Research and Development, The Ohio Department of 
Education, Columbus, Ohio (Eberhardt and Lloyd), and the Northern Illinois 
University, De Kalb, Illinois and the Region I Adult Education Service Center, 
Chicago, Illinois (Charuhas) are directed to evaluating curriculum materials. 
Since the quality of these documents varies considerably, a concluding 
statement within each description indicates which aspects of the contents 
are deemed to be valid for including in the course description of a teacher 
education program. 

De Luca specifies that the trainees, the prospective selectors of curriculum 
materials, develop a policy and procedure for selecting curriculum materials. 
A topic that includes content on selection policy and procedures is an 
essential component of a valid teacher education program. 

The document by The Center for Vocational Education specifies that teachers 
should achieve three objectives: firstly, demonstrate knowledge of the 
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important considerations involved in selecting curriculum materials; 
secondly, critique the performance of a teacher, described in that section 
of the module, in selecting curriculum materials; and thirdly, conduct a 
selection of instructional materials in an actual school situation. Each 
of these topics includes a valid skill for students to master within a 
teacher education program. 

In their instructional module developed for use in The Teacher Corps Bilingual 
Project, Hernandez and Melnick require students to be able to evaluate 
the content of curriculum materials. It is evident that this document was 
only developed for local use. Because the constructs of this material are 
poorly matched, application of its contents are not recommended for inclusion 
in a teacher education program. 

The document by the Far West Laboratory for Educational Research and 
Development specifies that the .trainees, multicultural educators, evaluate 
both illustrations and prose passages of curriculum materials for multicultural 
education for bias. Because the development of these skills are particularly 
important for improving the quality of bilingual-bicultural education and 
multicultural education, they are included within the contents of the teacher 
education program* 

The objectives of four of the five sections of Eberhardt and Lloyd relate to th 
assessment of reading competencies of students, readability analysis of 
curriculum materials, and the adaptation of curriculum materials to cater for 
iitudents* needs. Only the last section is concerned with the evaluation 
of curriculum materials by means of an instrument. Despite the subject- 
related emphasis of this document to reading instruction, the authors 
recognise the need for the content of reading materials to match learners' 
reading levels. This feature, togethpr with the need for participants to 
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apply ail instrument to the evaluation of curriculum materials, is an essential 
component of the contents of a valid teacher education program. 

The objectives of the twelve modules developed by Charuhas relate to four main 
features for evaluating curriculum materials: establishing antecedent conditions; 
evaluating the physical characteristics of curriculum materials; evaluating 
the content (bias and readability levels) of curriculum materials; and matching 
textbooks to curriculum objectives. The considerations given in the initial 
and concluding chapters of Charuhas, which relate the processes of selecting 
and evaluating curriculum materials, in the first case, to teaching-learning 
methods and, in the second case, to curricular contexts in which the curriculum 
materials are to be implemented, are particularly significant features to be 
included in the contents of a teacher education program. Although the coverage 
of the topics about evaluating the contents of curriculum materials is not 
treated comprehensively .in this document, content on both the evaluation of 
the contents and physical characteristics of curriculum materials must be 
included in a teacher education program. 

The topics addressed by the Educational Products Information Exchange Institute 
(n.d.)> are aimed at training the Institute's evaluators of curriculum materials 
and other educational products through an application of the technical facilities 
of the Educational Products Information Exchange Institute. The emphasis 
placed upon this aspect restricts the extent to which one can draw upon the 
contents of this module. Despite this, it is essential to include the basic 
ideas of this module within a valid teacher education program: the learning 
materials' continuum; Tyler's rationale; the 'bridge' analogy of instructional 
materials design and use; internal and external congruence; and an introduction 
to curriculum-content-evaluation correlation. 
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It is proposed, therefore, that the contents for a teacher education program 
in selecting and evaluating curriculum materials for bilingual-bicultural 
education and multicultural education should include the following contents 
selected from the documents for teacher education described in Chapter 3. 

1. the development, of a selection policy 

2. the development of a procedure for selecting curriculum materials 
for bilingual-bicultural education and multicultural education 

3. a critique of a teacher's performance in selecting bilingual- 
bicultural and multicultural curriculum materials 

4. the conduct of a selection of curriculum materials in the context 
of the participant's workplace 

5. the evaluation of bias in illustrations and prose passages in 
multicultural curriculum materials 

6. the evaluation of the readability (or language level) of multicultural 
and second language materials and the matching of these readability (or 
language) levels to students' levels of reading and language use 

7. the evaluation of the physical characteristics of curriculum materials 

8. an understanding about matching curriculum materials and curriculum 
constructs 

9. an understanding about the learning materials' continuum 

10. an understanding of Tyler's objectives model for curriculum 
development 

11. an understanding of the 'bridge' analogy 

12. an understanding of the internal and external congruences of 
curriculum materials 

13. an understanding of the curriculum-content-evaluation correlation 

In the author's opinion, certain additional topics must be included in the 
content of such a teacher education program. The program would include 
the following topics. 



1. the presentation of knowledge about alternative means for 
selecting curriculum materials (within a continuum extending from selection 
by individual selectors to selection by committee either inside or outside 
the educational context) 

2. the presentation of alternative techniques for selecting curriculum 
materials (within a continuum extending from the use of undefined criteria 
and standards to appraisal forms applying commonly agreed-upon criteria and 
standards) 

3. the presentation of alternative means for evaluating curriculum 
materials (within a continuum extending from individual evaluators, or 
individual evaluators and editors to an evaluation team operating inside or 
outside the educational context) 

4. the presentation of alternative techniques for evaluating curriculum 
materials (within a continuum extending from literary reviews to evaluation 
instruments based upon explicitly defined or optional curriculum models 

5. the presentation of knowledge about institutions and publications 
currently contributing to the selection and evaluation of curriculum materials 

6. the presentation of knowledge about problems inherent in curriculum 
materials : 

- the characteristics of quality in curriculum materials including 

the lack of criteria to define such quality 

- the conduct of research in curriculum materials to provide needed 

answers showing the inadequacy of the experimental model of 
research to adequately investigate the problems of curriculum 
materials particularly those designed to impart values 

- the incorporation of forms of learner-based verification and 
revision showing their applicability to different types of learning 
materials, compilation of such data by valid and reliable trial-- 
testing and field-testing procedures 

- the need to define responsibility for learning resulting from 
curriculum materials 
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7. the presentation of knowledge and skills about the selection and 
evaluation of curriculum materials for bilingual-bicultural education and 
multicultural education 

4.3.3 Organising Content 

Following selection of the content, Taba stated that its organisation should 
depend upon an order based upon a feasible learning sequence. Taba believed 
that the sequence may require combining ideas viewed independently in the 
previous step; sequencing ideas commencing from those that provide informative 
background for more complex ideas, and sequencing ideas on the basis of 
increasingly difficult mental operations. Taba proposed that a curriculum 
developer should apply these criteria collectively to determine the order of 
the content. The pattern for organising content should be based upon 
determining the topic, the basic ideas, the sample of content, and questions 
representing the dimensions of study. 

The topics, listed in Section 4.3.2, have been ordered following the 
prerequisite steps recommended by Taba. The outline of this ordering is 
presented in Table 8. Table 8 shows that the contents of the teacher 
education program have been organised into four topics: firstly, the 
characteristics of bil ingual-bicultural and multicultural curriculum materials; 
secondly, assessing producers' validation activities; thirdly, selecting, 
adopting and utilising curriculum materials; and fourthly, evaluating 
curriculum materials. 



The predominant aim in sequencing the organisation of the contents of this 
teacher education program is to comply with the prerequisites identified by 
Eraut et a£. In substance, these authors avoided either a subject-oriented 
approach or a separate course in curriculum studies by integrating both the 
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Table 8: The Organisation of the Content for the Teacher Education Program 



Topics of Study 



Dimensions of Study 



Questions for Stu^y 



1. The character- 
istics of bilingual- 
bicultural and 
multicultural 
curriculum 
materials 



1.1 linguistic content: 
criteria for judging linguiS' 
tic content of the second 
language of bilingual- 
bicultural curriculum 
materials 

— standard: uses second 
language material under- 
stood by most world-wide 
speakers 

— dialect: uses second 
language material 
characteristic of a region 

— culturally charged: 
uses words or phrases in the 
second language material 
characteristic of a 
particular ethnic group that 
have no equivalents in the 
language used by other 
ethnic groups, nor are they 
translatable 

— unacceptable: uses 
second language material of 
unacceptable overall standards 
in linguistic content 
(morphology, syntax) 

1.2 language level: criteria 
for judging the language level 
of the second language of 
bil ingual -bicultural 
curriculum materials 

— beginner: material 
designed for learners with no 
or limited experience in the 
second language 

— intermediate: material 
designed for learners with 
some experience in the second 
language 

— advanced: material designed 
for learners fluent in the 
second language 

1.3 bias in illustrations: 
criteria for judging bias in 
illustrations of bilingual- 
bicultural and multicultural 
curriculum materials 

— living conditions: a variety 
of settings for living are shown 
that reflect the conditions of 
a minority group 



1.1.1 What is the standard 
form of a language, a dialect, 
culturally charged content, 
and unacceptable morphological 
and syntactic content? 

1.1.2 How is the linguistic 
content of the second language 
of bil ingual-bicul tural 
curriculum materials 
evaluated? 



1.2.1 What is generally 
accepted to be the language 
level of a second language 
in bilingual-bicultural 
curriculum materials? 

1.2.2 How is the language 
level of a second language 
in bilingual-bicultural 
curriculum materials evaluatec 



1.3.1 What is 
illustrations 



bias in 
presented 



in 



curriculum materials? 
1.3.2 How is bias in illustr- 
ations evaluated? 
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Topics for Study 



2. How to assess 
producers * 
evaluation 
activities 



Dimensions of Study 



Questions for Study 



— occupational roles: adults 
of a minority group are shown in 
a variety of occupational roles 

— characterisation: characters 
of a minority group should be 
expressive and demonstrate 
expressions compatible with their 
situations 

— physical features: minority 
characters should show varying 
complexions and other physical 
features 

1.4 bias in the written content: 
a criterion for judging bias in 
the written content of bilingual 



1.4.1 What is bias in the 
written content presented 
in curriculum materials? 



bicultural and multicultural 
curriculum materials 
— evaluative coefficient 
analysis: provides a quantitative 
index of the treatment of minority 
groups 



1.4.2 How is bias in the 
written content evaluated 
in curriculum materials? 



2.1 assessing the characteristics 
of qual ity 

2.2 research about curriculum 
materials 



2.3 product validation 
2.3.1 preliminary verification 
and revision 
2.3.1.1 inspection 



2.3.1.2 simulation 
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2.1.1 What criteria can be 
used to determine quality 
in curriculum materials? 
2.2.1 What research models 
are best for investigating 
different types of curriculum 
materials? 



2.3.1.1.1 At what stage in 
a curriculum material's 
development should inspection 
be conducted? 

2.3.1.1.2 How is inspection 
of a curriculum material 
conducted? 

2.3.1.1.3 Who should inspect 
a curriculum material? 

2.3.1.1.4 What forms of 
revision to a curriculum 
material should occur after 
inspection? 

2.3.1.2.1 At what stage in a 
curriculum material's 
development should simulation 
be conducted? 

2.3.1.2.2 How is simulation 
of a curriculum mater** al 
conducted? 

2.3.1.2.3 Who should conduct 
a simulation of a curriculum 
material? 

2.3.1.2.4 What forms of 
revision to a curriculum 
material will occur after 
simulation? 



Topics of Study 



Questions for Study 



2.3.2 learner-based verif- 
ication and revision 
2.3.2.1 pilot trial 



2.3.2.2 pilot test 



2.3.2.3 field trial 



2.3.2.4 field test 



2.4 the responsibility of 
the publisher for learning 
occurring from curriculum 
materials 



2.3.2.1.1 At what stage in a 
curriculum material's develop- 
ment should pilot trial ling 
be conducted? 

2.3.2.1.2 How is pilot triallinc 
of a curriculum material 
conducted? 

2.3.2.1.3 Who should pilot 
trial a curriculum material? 

2.3.2.1.4 What forms of revisior 
should occur to a curriculum 
material after pilot trialling? 

2.3.2.2.1 At what stage in a 
curriculum material ' s developmer 
should pilot testing be 
conducted? 

2.3.2.2.2 How is pilot testing 
of a curriculum material 
conducted? 

2.3.2.2.3 Who should pilot test 
a curriculum material? 

2.3.2.2.4 What forms of revisior 
to a curriculum material should 
occur after pilot testing? 

2.3.2.3.1 At what stage in a 
curriculum material's develop- 
ment should field trialling be 
conducted? 

2.3.2.3.2 How is field triallim 
of a curriculum material 
conducted? 

2.3.2.3.3 Who should field tria* 
a curriculum material? 

2.3.2.3.4 What forms of revisioi 
should occur to a curriculum 
material after trialling? 

2.3.2.4.1 At what stage in a 
curriculum material's develop- 
ment should field testing be 
conducted? 

2.3.2.4.2 How is field testing* 
of a curriculum material 
conducted? 

2.3.2.4.3 Who should field test 
a curriculum material? 

2.3.2.4.4 What forms of revisio 
should occur to a curriculum : 
material after field testing? : 

2.4.1 What outcomes for learner; 
does the publisher intend that^ 
the curriculum material 
achieve? 

2.4.2 With which target 
population does the publisher 
intend the material to be used? 
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topics of Study 



3. Selecting, 
adopting and 
utilising 
curricul um 
materials 



4. Evaluating 

curriculum 

materials 



Dimensions of Study 



3.1 the different techniques 
for selecting curriculum 
material s 

3.2 the different means of 
selecting curriculum 
material s 

3.3 the different techniques 
for adopting curriculum 
material s 

3.4 the different means of 
adopting curriculum materials 

3.5 the different techniques 
for utilising curriculum 
material s 

3.6 the different means of 
utilising curriculum 
material s 



4.1 the learning materials' 
continuum (ERIE Institute) 



4.2 Tyler's rationale of 
curriculum development 



4.3 the 'bridge' analogy 
(ERIE Institute) 
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Questions for Study 



2.4.3 What techniques does the 
publisher use to gather 
feedback from learners about 
curriculum materials? 

2.4.4 What descriptions does 
the publisher provide of 
procedures adopted ror product 
validation? 

2.4.5 To what extent does the 
publisher provide information 
about his analysis of findings 
from product validation? 

2.4.6 What evidence does the 
publisher provide about specif 
improvements made to the 
curriculum material following 
product validation? 

3.1.1 How should the selection 
of curriculum materials 
occur? 

3.2.1 Who should select 
curriculum materials? 

3.3.1 How should the adoption 
of curriculum materials occur? 

3.4.1 Who should adopt curricu 
material s? 

3.5.1 How should the process fi 
utilisation of curriculum 
materials occur? 
3.6.1 Who should be involved 
in the process for utilisation 
of curriculum materials? 



4.1.1 What is the learning 
material's continuum? 

4.1.2 How does an understanding 
of the learning materials" 
continuum improve the evaluatii 
of curriculum materials? 

4.2.1 What is Tyler's rational' 
of curriculum development? 

4.2.2 How can the objectives//; 
model (Tyler's rationale) of 
curriculum development be 
applied to evaluating 
curriculum materials? 

4.2.3 Are other models of 
curriculum development approp- 
riate for evaluating curriculu 
materials? :S 

4.3.1 What does ERIE Institute 
'bridge' analogy explain? : 

4.3.2 What are the implication 
of the 'bridge' analogy for, 
evaluating curriculum 

materials? 



generic-oriented and the subject-oriented contents within a multidisciplinary 
approach in which team teaching is an important component. The organisation 
of the contents of the teacher education program meets this prerequisite by 
initially focussing those participants with expertise in bil ir.gual-bicul tural 
education or multicultural education upon critical issues for the selection 
and the evaluation of curriculum materials within their discipline. It can 
be surmised that participants with expertise in other content areas of the 
curriculum will, at this time, be engaged in an appropriate topic. For the 
three remaining topics, the focus is then directed to generic-oriented issues 
in selecting, adopting and evaluating curriculum materials. Although the 
organisation of the contents complies, in these ways, with the prerequisites 
stated by Eraut aZ.^ this particular organisation is not intended to 
determine the sequencing of the topics for the program. By allowing for 
flexibility in the sequencing of topics, those implementing the program can 
apply it to different contexts as well as meet the requirements of team- 
teaching roles and tasks. The issues involved in implementing this teacher 
education program in different contexts are discussed in Chapter 5. 

4.3.4 Selecting and Organising Learning Experiences 

Taba indicated that two fundamental criteria are encompassed in selecting 
learning experiences. Firstly, she stated that an initial criterion for 
selecting learning experiences is that the ideas in the topics should serve 
a function. It is apparent that such functions should relate to the purpose 
of the program, its aims and its specific objectives. In providing 
effective learning experiences, Taba saw the need to express the learning 
experiences in terms of what performances and behaviours students should 
master to attain particular competencies. Secondly, she believed that an 
order should be formulated among learning experiences. 
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Sequencing of learning experiences involves four main stages: activities for 
introduction, opener and orientation; activities for development, analysis 
and study; activities for generalisation; and activities for application, 
summary and culmination. Introductory activities are designed to fulfil 
five functions: to provide diagnostic evidence to the instructor; to assist 
the students relate the topic to their own experience; to arouse interest; 
to provide descriptive information about the main issues; and to motivate the 
student. Additionally, this stage may include planning with students, and 
occasionally preparing feelings and sensitivities of the students to main 
issues. l}^.e second stage provides learning activities involving reading, 
research, analysis of data, group work and study of various types. The 
third stage provides students with the scope to compare and contrast the 
significant ideas and formulate conclusions. The final stage provides the 
opportunity to assess and evaluate, or apply what has been learnt to a new 
situation. Taba does not offer precise statements about selecting teaching- 
learning methods. She is careful to express, however, the need to present 
learning exp.vi^nces through a variety of ways, without specifying different 
types of approaches to learning. Taba believed that the use of different 
media — aural, graphic, and kinesic — is important. 

Selecting learning experiences for a teacher education program will depend 
upon what has been shown to be effective practice for adult learning. 
The evidence established through research indicates that particular 
characteristics are associated with adult learning. In a recent summary 
of this research, Christensen et al. (1983) identify several characteristics 
of adult learners: they show a problem-centred orientation; they show 
preferences to redefine a problem during the process of learning; their 
initiation into the learning sequence is often through identifying its 
relationship to experiences; they have varying personalities, physical and 
social experiences which must be recognised; they are judgmental; and they 
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OrgEni^ation of the Learning Expenenees-for-^^ 

Education Program 



Topic 



Content 



Learning Experiences 



1. The character- 
istics of bilingual- 
bicultural and 
multicultural 
curriculum 
materials 



1.1.1 linguistic content 



1.1.2 language level 



1.1.3 bias in the 
illustrations 



1.1.4 bias in the written 
content 



1J2.1 linguistic content 

1.2.2 language level 

1.2.3 bias in the 
illustrations 

1.2.4 bias in the written 
content 

1.3.1 linguistic content 

1.3.2 language level 

1.3.3 bias in the 
il lustrations 

1.3.4 bias in the written 
content 



1.1 Introductory 
1.1.1.1 Ask the participants to 
answer: Why do you believe that 
it is important for the linguisti 
content to represent the standarc 
form of the second language in 

bi 1 i ngual -bi cul tural curri cul um 
material s? 

1.1.2.1 Ask the participants to 
answer: Why do you believe that 
it is important for the language 
level of bilingual-bicul tural 
curriculum materials to be 
consistent with the development 
of the skills of individual 
learners? 

1.1.3.1 Ask the participants to 
answer: Why do you believe that 
it is important for portrayals 
of people of minority groups, 
depicted in illustrations of 
curriculum materials, to reflect 
their cultures and experiences 
accurately? 

1.1.4.1 Ask the participants to 
answer: Why do you believe that 
it is important for portrayals 
of people of minority cultures 
in the written content of 
curriculum materials to reflect 
their cultures and experiences 
accurately? 

1.2 Development, analysis and 
study 

1.2.1.1 Ask each participant to 
complete Exercise 1.2.1. 
1.2.2.1 Ask each participant to 
complete Exercise 1.2.2. 
1.2.3.1 Ask each participant to 
complete Exercise 1.2.3. 
U2.4.1 Ask each parti ci pane to 
complete Exercise 1.2.4. : 

1.3 Generalisation 

1.3.1.1 Ask each participant to 
complete Exercise 1.3.1. 
1.3.2.1 Ask each participant to 
complete Exercise 1.3.2. 
1.3.3.1 Ask each participant to. 
complete Exercise 1.3.3. 
1.3.4.1 Ask each participant to 
complete Exercise 1.3.4. 



Topic 



Content 



Learning Experiences 



1,4,1 linguistic content 



1A.2 language level 



1.4.3 bias in the 
illustrations 



1.4.4 bias in the written 
content 
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1.4 Application 
1.4.1.1 Whilst working in an 
actual school situation, select 
instructional materials for your 
students that relate to their 
needs in linguistic content. 
For instance, if your students 
speak the standard form of the 
second language, select curriculu 
materials that are written only 
in the standard form. For a 
single lesson you are planning 
to teach, evaluate and select 
curriculum materials by applying 
the techniques specified in 
Exercise 1.2.1 and Exercise 1.3.1 
1.4.2.1 Whilst working in an 
actual school situation, select 
instructional materials that 
match the language level of your, 
students' use of the second 
language. For a single lesson 
that you are planning to teach, 
evaluate and select curriculum 
^materials by applying the 
techniques specified in Exercise 
1.2.2 and Exercise 1.3.2. 
1.4.3.1 Whilst working in an 
actual school situation, select 
instructional materials in which 
the illustrations are unbiased. 
For a single lesson that you are 
planning to teach, evaluate and • 
select curriculum materials by 
applying the techniques specifiec 
in Exercise 1.2.3 and Exercise 
1.3.3. 

1.4.4.1 Whilst woj^king in an 
actual school situation, select 
instructional materials in which 
the written content is unbiased. ^ 
For a single lesson that you are 
planning to teach, evaluate and 
select curriculum materials by v 
applying the techniques specifiec 
in Exercise 1.2.4 and Exercise 
1.3.4. 
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Exercise 1.2.1 and Exercise 1.3.1: Analysing the Linguistic Content in the 
Second Language of Bilingual-bicultural Curriculum Materials 



Participant's Edition 



Objective: To determine to what extent the linguistic content in the second 
language of a textbook is written in the standard form, a dialect, contains 
culturally charged vocabulary, or unacceptable morphological and syntactic 
forms. 

Materials Needed: 

1. A textbook that you use frequently with a group of students. The 
textbook should be appropriate to the age range of the particular students. 

2. The Checklist, and The Evaluation Form 



Instructions: 

1. Examine the textbook to determine what teaching-learning approach has 
been adopted. Several, varying approaches are used for instruction in second 
languages: 

— grammar-translation (indirect) method; 

— cognitive code; 

— direct method; 

— audiolingual method; 
audiovisual method; 

— natural approach; 

— total physical response; 

— suggestopedia; 

— the silent way; 

— counsel ling-learning; 

— eclectic approach; or 

— other method. 

2. Select this textbook if the teaching-learning approach is compatible with 
the teaching-learning approach you intend to use with your group of students. 

3. Select the appropriate section of the textbook you intend to present to 
your group of students. The contents of most second language textbooks will 
be sequenced from simple tasks to more difficult tasks. 

4. Apply the following technique to examine the textbook: 

Textbook : Determine if the linguistic content of the textbook is 
consistent with the linguistic forms used by the students in your group. 

Note: Turn to the Checklist 

5. List the page nuniber of each exercise on the Checklist. 

6. This task requires your judgment. For each exercise you have indicated, 
check the appropriate box on the Checklist under the headings: Dialect; 
Culturally Charged Language; and Unacceptable Language. 



Note: Turn to the Evaluation Form 

7. Referring to the Checklist, count the number of times you checked 'yes' 
for each of the characteristics. Record your tallies for each characteristic 
at Item 1, Item 2 and Item 3 on the Evaluation Form. 

8. Show whether the language use in the second language of your students 
contains instances of dialect, culturally charged language, or unacceptable 
language. 

9. ^ Match your judgments about the use of each characteristic in the textbook, 
as indicated at Item 4, and the language use of your students, as indicated at 
Item 5. 

10. If the characteristics oi these two items match, check the appropriate 
box on Item 6 of the Evaluation Form. Select the textbook on the basis of 
this rating. 
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Exercise 1.2.1 and Exercise 1.3.1 Analysing ihe Linguistic Content 
in the Second Language of Bil ingual-bicultural Curriculum 
Material s 



Description of the Material 



!• Book Title 



2. Author 



3. Publisher 



4. Place of Publication 



5. Date of Publication 



Exercise 1.2.1 Checklist 

1. State the page number of each instructional exercise* 

2. State whether each instructional exercise presents instances of 
dialect, culturally-charged language and unacceptable language. 
Check the appropriate box for the characteristic which you believe 
is presented in the exercise. 
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No. 


Page No. 


Dialect 


1 

1 

Culturally-charged 


Unacceptable 


i 




Yes 


No 


Yes 

i 


NO 


Yes 


No 


' 1. 




[ 1 
t 






i 


2. 




i 
1 

1 








3. 




1 i 
1 

* 1 








4. 




! 
i 




i i 


1 

i 5. 

i 




i 




4 

f ! 


! 6. 

i 




1 

i 








i 7. 




! 






i 
i 
i 


8. 




: 1 

1 r 

1 ! 






3 


9. 




1 










10. 




J 
J 

1 










11. 






i 










12. 
















13. 
















14. 
















15. 
















16. 
















17. 
















18. 
















19. 
















20. 
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Evaluation Form 

State the total number of times you checked 'yes* for Dialect 



State the total number of times you checked 'yes' for Culturally 
Charged Language 

State the total number of times you checked 'yes' for Unacceptable 
Language 

State the percentage of times you checked 'yes' for: 

- dialect % 

- culturally charged language % 

- unacceptable language % 

Check for instances of each characteristic in the language use of 
your students, 

dialect 

culturally charged language 
unacceptable morphology and syntax 
Check the box that corresponds to your answers, 

70% - 100% □ dialect High percentage of 

□linguistic features 

culturally charged that do not represent 

language the standard form of 

□the second language, 
unacceptable language 

50% - 69% □ dialect Moderate percentage 

□of 1 inguistic 

culturally charged features that do not 

language represent the 

□standard form of the 

unacceptable language second language. 

less than CH dialect Low percentage of 

50% r-1 linguistic features 

L-J culturally charged that do not represent 

language the standard form 

□of the second 

unacceptable language language. 
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Exercise 1.2.2 and Exercise 1.3.2: Analysing the Language Level of the 
Content in the Second Lannuage of Bil ingual-bicul tural Curriculum Materials 



Objective: To determine to what extent the language in the second language 
of a textbook is suitable for a beginner, an intermediate learner or for an 
advanced learner. 



Materials Needed: 

1. A textbook that you use frequently with a group of students. The 
textbook should be appropriate to the age range of the particular students. 

2. TTie Checklist, the Evaluation Form, and the Rating Form. 



Instructions: 

3. Examine the textbook to determine what teaching-learning approach has 
been adopted. Several varying approaches are used for instruction in 
second languages: 

— grammar-translation (or indirect) method; 

— cognitive code; 

— direct method; 

— audiolingual method; 

— audiovisual method; 

— natural approach; 

— total physical response; 

— suggestopedia; 

— the silent way; 

— counsel ling-learning; 

— eclectic approach; or 

— other method. 

4. Select this textbook if the teaching-learning approach is compatible 
with the teaching-learning approach you intend to use with your group of 
students. 

5. Select an appropriate section of the textbook you wish to present to 
your group of students. The contents of most second language textbooks 
will be sequenced from more simple tasks to more difficult tasks. You 
should select student instructional exercises that present a balance 
between listening skills, speaking skills, reading skills, or writing 
skills. 

6. If this textbook fulfils this need, apply the following technique: 

Section 1: Determine if the presentation of listening skills is 
appropriate to the language level of individual students in your 



Participant's Edition 



group. 



Section 2: 

appropriate 

group. 



Determine if the presentation of speaking skills is 
to the language level of individual students in your 
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Section 3: Determine if the presentation ot Teadlng ski 11 s is 
appropriate to the language level of individual students in your 
group. 

Section 4: Determine if the presentation of writing skills is 
appropriate to the language level of individual students in your 
group. 

Note: Turn to the Checklist. 

7. List the page number of each exercise on the Checklist. 

8. This task requires your judgment. For each exercise, you have 
indicated, check the appropriate box at the appropriate level on the 
Checklist under the headings: Listening; Speaking; Reading; and Writing. 

Note: Turn to the Evaluation Form. 

9. Referring to the Checklist, count the number of times you checked 
'yes' for each level within each skill. Record your tallies for each 
level at It^m 1, Item 2, Item 3 or Item 4 on the Evaluation Form. 

10. For each skill, select the level for which the highest score is 
indicated. Convert the scores to percentages. Indicate each percentage 
on the appropriate level at Item 5 on the Evaluation Form. 

11. Check the appropriate language level of each skill at which you 
judge your group of students has attained. 

12. For each skill, match your judgment of the language level checked on 
Item 6 of the Evaluation Form with the language level for the textbook 
indicated at Item 5 of the Evaluation Form, If the levels for these two 
items match, check the appropriate box on Item 7 of the Evaluation Form. 
Select the appropriate exercises for each skill on the basis of the 
evaluations given at Item 7. 
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Exercise 1.2.2 Analysing the Language Level of the Content in 
the Second Language of Bil ingual-bicultural Curriculum Materials. 
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Description of the Material 



1. Book Title 



2. Author 



3. Publisher 



4. Place of Publication 



5. Date of Publication 
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Exercise 1,2,2 Checklist 

1, State the page number of each instructional exercise. 

2, State whether each instructional exercise presents listening skills, speaking skills, reading skills or writing 
skills. 

Check the appropriate box for the level in which you believe the exercise is presented. 



lo. Page No. 



1. 
2. 
3. 
4. 
5. 
6. 
7. 
8. 
9. 
10. 
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Listening 



inner 



Inter- 
mediate 



anced 



Speaking 



inner 



Inter- 
mediate 



anced 



Reading 



inner 



Inter- 
mediate 



Adv- 
anced 



Writing 



inner 



Inter- ' Adv- 
mediate! anced 
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Exercise 1.3.2. 



Evaluation Form 

1. State the total number of times you checked *yes' for 
Listening at the: 

beginner level 

intermediate level 

advanced level 

2. State the total number of times you checked *yes* for 
Speaking at the: 

beginner level 

intermediate level 

advanced level 

3. State the total number of times you checked *yes* for 
Reading at the: 

beginner level 

intermediate level 

advanced level 

4. State the total number of times you checked 'yes* for 
Writing at the: 

beginner level ; . 

intermediate level 

advanced level 

5. In each case, select the level for which the highest score 
is indicated. Convert this score to a percentage. State 
the number of times you checked *yes' for: 

listening at % for the level 

speaking at % for the level 

reading at % for the level 

writing at % for the level 
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Check the language level of the students in your group for: 



1 istening: 



speaking: 



reading: 



writing: 



beginner 

intermediate 

advanced 

beginner 

intermediate 

advanced 

beginner 

intermediate 

advanced 

beginner 

intermediate 

advanced 



□ 
□ 
□ 

□ 
□ 
□ 

□ 
□ 
□ 

□ 
□ 
□ 



Check the box that corresponds to your answers; 



70%-100% 



50%-69% 



less than 50% 



□ Listening 
Speaking 
Reading 

n Writing 

Listening 
Speaking 
Reading 
Writing 

Listening 
Speaking 
Reading 
Writing 



Excellent percentage of 
skills at this level 



Standard percentage of 
skill s at this level 



Inadequate percentage of 
skills at this level 
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Exercise 1.2.3 and Exercise 1.3.3: Analysing IlJustrations in Bilingual 
bi cultural and Multicultural Curriculum Materials-*- 

Participant's Edition 



Objective: To determine to what extent the illustrations in a textbook 
include realistic portrayals of people of a particular culture. 



Materials Needed: 

1. A textbook that you use frequently with a group of students. The 
textbook should be appropriate to the age range of the particular students. 

2. The Checklist, the Evaluation Form, and the Rating Form. 



Instructions: 

1. Skim through the textbook quickly to see whether the illustrations 
depict people of a particular culture that you wish your students to study. 

2. If this textbook fulfils this need, select this book and apply the 
following techniques: 

Technique 1: Determine if there is an adequate percentage of illustrations 
depicting people of the particular culture. 

Technique 2: Determine if the illustrations depicting people of the 
particular culture show a realistic representation of the particular 
culture. 

Note: Turn to the Checklist. 

Technique 1 

3. Starting at the title page of the textbook, count each illustration 
that includes people. 

4. After you complete the count, record on the Checklist the number of 
illustrations that show people. 

Technique 2 

5. Start again at the title page of the book. List the page number of 
each illustration that shows people of the particular culture. The page 
number should be listed on the Checklist. Also record the number of 
illustrations that depict people of the particular culture. 

6. Calculate the percentage of illustrations depicting people of the 
particular culture. Record the percentage on the Checklist. 

7. For each illustration depicting people of the particular culture, 
determine whether it depicts accurately their 

— living conditions. 

— occupational roles. 

— characterisation. 

— physical features. 
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8. This task requires your judgment. '" Check the approp>Tate 'Box^biTthe 
Checklist under the headings: Living Conditions; Occupational Roles; 
Characterisation; and Physical Features. 

Note: Turn to the Evaluation Form 

Technique 1 

9. Divide the number you recorded for Item 2 on the Checklist by the 
number you recorded for Item 1 on the Checklist. Convert the fraction to 
a percentage. Record the percentage at Item 1 on the Evaluation Form. 

10. Estimate the quantity of illustrations depicting people of the particular 
culture at Item 2 on the Evaluation Form. 

Technique 2 

11. Referring to the Checklist, count the number of times you checked 
'yes' for each of the four characteristics. Record your tallies for each 
at Item 3, Item 4, Item 5 or Item 6 on the Evaluation Form. 

12. Calculate the percentage of times you checked 'yes' for each characteristic. 
Record the percentage for each characteristic at Item 7 on the Evaluation Form. 

13. Estimate the quantity for each characteristic at Item 8 on the 
Evaluation Form. 

Note: Turn to the Rating Form 

Technique 1 and Technique 2 

14. Score each characteristic at Item 1 on the Rating Form. 

15. Rate the illustrations in the textbook at Item 2 on the Rating Form. 



^ . This topic has been developed from the module published by the Far West 
Laboratory for Educational Research and Development. 



Exercise 1.2.3 Analysing Illustrations in Bilingual-BicuUural 
and Multicultural Curriculum Materials 



Description of the Material 

1. Book Title 

2. Author 

3. Publisher 

4. Place of Publication 

5. Date of Publication , 

Checkl ist 

Exercise 1.2.3 
Technique 1: 

1. State the number of illustrations depicting people. 

2. State the number of illustrations depicting people of the 
particular culture. 

Technique 2: 

3. State the page number of each illustration depicting people of a 
particular culture. 

4. State whether each illustration depicts living conditions, 
occupational roles, characterisation, and physical features. Check 
the appropriate box. 
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Exercise 1.3.3 Rating Form 



No. 


Page No. 


Living 
Conditions 


Occupational 
Roles C\] 


aracteri sation 


Physical 
Features 


yes 


no 


n/a 


yes 


no 


n/a 


yes 


no 


n/a 


yes 


r- 

; no 

t 

1 


n/a 


1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 

10. 

11. 

12. 

13. 

14. 

15. 

16. 

17. 

18. 

19. 

20. 

21. 

22. 

23. 

24. 

25. 






i 
I 
1 










i 






1 
1 

1 


1 

i 


i 
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Exercise 1,3,3 



Evaluation Form 



Technique 1: 

1. State the percentage of illustrations depicting people of a 
particular culture. % 

2. Check the box that corresponds to your answer: 

50% - 100% Excellent percentage of 

illustrations depicting people of a 
particular culture. 

20% - 49% Standard percentage of illustrations 

depicting people of a particular 
culture. 

less than 20% Inadequate percentage of 

illustrations depicting people of a 
particular culture. 

Technique 2: 

3. State the total number of times you checked 'yes' for Living 
Conditions. 



4. State the total number of times you checked 'yes' for Occupational 
Roles. 



5. State the total number of times you checked 'yes' for 
Characterisation. 



131 



6. State the total number of times you checked 'yes* for Physical 
Features. 



7. State the percentage of times you checked 'yes* for: 

Living Conditions % 

Occupational Roles % 

Characterisation 

Physical Features % 



8. Check the box that corresponds to your answers: 



50 - 100% n Living Conditions 

[—1 Occupational Roles 

n Characterisation 

I— -I Physical Features 



Excellent percentage 
of illustrations 
depi cting people of 
a particular culture. 



20% - 49% [H Living Conditions 

C Occupational Roles 

d Characterisation 

1—1 Physical Features 



Standard percentage 
of illustrations 
depicting people of 
a particular culture. 
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less than 20% Living Conditions 

Occupational Roles 
Characterisation 
Physical Features 



Inadequate percentage 
of illustrations 
depicting people of a 
particular culture. 
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Technique 1 and Technique 2 



1. Use the results of the information on the Evaluation Form to score 
the book you have analysed. 



Area 


Characteristic 


Check appropriate box 


Scoring 


Technique 1 


111 ustrations 
depicting people 
of a particular 


Excellent 

Standard 

Inadequate 


= 10 
= 5 
= 0 




Technique 2 


1 Living 
Conditions 


Excel 1 ent 

Standard 

Inadequate 


• • • 

O LO o 

11 11 11 






2 Occupational 
Roles 


Excellent 

Standard 

Inadequate 


• • • 

O LO o 

11 11 11 






3 Characterisation 


Excellent 

Standard 

Inadequate 


11 11 11 

O CJl o 

• • • 






4 Physical 
Features 


Excel 1 ent 

Standard 

Inadequate 


= 10 
= 5 
= 0 





TOTAL SCORE 
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Rate the illustrations depicting people of the particula 
culture in the textbook. 



Point Range 

30-40 
20-29 
0-19 



Textbook Rating 

Excellent 

Standard 

Inadequate 
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Exercise L2.4 and Exercise 1.3.4 Analysing the Written Content in 
Bilingual-bicultural and Multicultural Purriculuni Materialsl 

Teacher's Manual 

Objective: To determine to what extent the written content in a textbook 
is racially biassed. 

Materials Needed: 

1. A textbook that you use frequently with a group of students in the 
range of grades 5 through 12. The textbook should be appropriate to the 
age range of the particular group of students, 

2. The Evaluative Coefficient Score Sheet , and the Evaluative Coefficient 
Word List3. 



Instructions : 

1. Skim through the textbook quickly to see whether the written content 
describes the culture that you wish your students to study. 

2. If this textbook fulfils this need, select this book and apply the 
following technique: 

Technique: Determine if there is an adequate percentage of words 
that reflect the particular culture. 

Note: Turn to the Evaluative Coefficient Score Sheet, and the Evaluative 
Coefficient Word List. 

3» Complete the details about the textbook at the head of the Evaluative 
Coefficient Score Sheet. State the name of the particular culture being 
eval uated. 

4. Select the appropriate section of the textbook you wish to present to 
your group of students. 

5. Starting at the appropriate page of the textbook, read the section 

you intend presenting to your group of students. As you read the textbook, 
record all the words listed on the Evaluative Coefficient Word List that 
are found in the content of the textbook on the Evaluative Coefficient 
Score Sheet. The words you list may also be adjectives, adverbs, nouns or 
verbs derived from the words listed on the Evaluative Coefficient Word List. 

6. Using the Evaluative Coefficient Word List, list a positive, neutral 

or negative value for each word you have listed on the Evaluative Coefficient 
Score Sheet. Where a word is negatively associated with a subject, the 
scoring should be reversed. 

7. If you have written more than a minimum of ten words on the Evaluative 
Coefficient Score Sheet, calculate the coefficient of evaluation by using 
the formula: lOOF , where F=number of favourable terms, and U=number of 

F+IT 

unfavourable terms. 
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8. Rate the written content of the section of the textbook you have 
selected. The Coefficient of Evaluation will always be between 0 
(totally unfavourable) and 100 (totally favourable) with 50 representing 
the point of neutrality. 



1 This topic has been developed from the publication by D. Pratt (1971), 
'Value Judgments in Textbooks: the Coefficient of Evaluation as a Quantitative 
Measure', T^vtoAckang^^ 2:3, 7-9. The topic is printed in an adapted form 
with permission from The Ontario Institute for Studies in Education. 

2 See D. Pratt (1971), 8. 

3 See D. Pratt (1972), Hou) to Find and IAzomxaz Bajou> In Tz)ctbook£>^ Englewood 
Cliffs: Educational Technology Publications, 39-44. Jhe Evaluative Coefficient 
Word List cannot be printed in the Teacher's Manual because of a copyright 
restriction. 



Exercise 1.2.4 Analysing the Written Content in Bilingual- 

bicultural and Multicultural Curriculum Materials 



Description of the Material 



1. Book Title 



2. Author 



3. Publisher 



4. Place of Publication 



5. Date of Publication 
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1. Name of Group - Evaluative Coefficient Score Sheet 



page 


term 


di recti on 


page 


term 


direction 


1. 






21, 








2. 






22. 








3. 






23. 








4. 






24. 








5. 






25. 








6. 






26. 
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allocate their resources to activities on the basis to which these activities 
meet their needs. This situation is most successfully recognised by Charuhas 
among the writers of the teacher education materials available for the selection 
and the evaluation of curriculum materials. The author has also endeavoured to 
take account of the prerequisites of effective practice for adult learners in 
organising the learning experiences of this teacher education program. 

The organisation of the learning experiences for the first topic is presented 
in Table 9. In keeping with the intention of presenting a teacher education 
program for bilingual-bicul tural and multicultural educators, only the learning 
experiences for the first topic are presented in chis paper. It is expected 
that the learning experiences for the remaining topics would be developed and 
implemented in a context appropriate to all educators in a workshop. 

4.3.5 Evaluating 

When developing an instructional program, Taba emphasised that the perspective 
for student evaluation should consist of both formative and summative features^ 
Taba also believed that these features should incorporate both the more 
informal means of assessment, such as observational techniques, and formal 
testing. 

As previously mentioned, Willis, ED 125 654, has developed a set of tests to 
assess teachers' skills of selecting and evaluating computerised instructional 
materials. Several of the teacher education modules De Luca, ED 120 986; 
The Center for Vocational Education, ED 149 063; Hernandez and Mel nick, 
ED 095 141; and Eberhardt and Lloyd, ED 106 753 described in Section 3.4, 
also contain, as part of their constructs, the means for student assessment. 
Aspects of these materials have been incorporated in the test specifications ^ . 
developed to assess students in this teacher education program. 
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Because the emphasis of this teacher education program has been placed upon 
the development of skills for selecting and evaluating curriculum materials, 
criterion-referenced testing is viewed as a particularly appropriate means 
for student assessment. Development of criterion-referenced test specifications 
for both formative and summative evaluations of student performances in 
selecting and evaluo^ing curriculum materials, is directed to assessing the 
skills of bi nngual~l icultural and multicultural educators specifically in 
relation to Topic 1. 

Popham (1978) has specified a number of key operations in developing test 
specifications for criterion-referenced measures: defining the test's 
descriptive scheme; creating homogeneous item pools; determining the test's 
length; and improving the quality of the test's items. Each of these 
operations has been taken into account in developing the test specifications 
shown in Table 10. Following the procedures recommended by Popham, the test 
specifications include four of his five components. 

1. General description: A description of the behaviour being assessed. 

2. Sample item: A sample item that reflects the attributes of test 
items developed in the following two components. 

3. Stimulus attributes: A set of criteria that specify the nature of 
the stimulus material that will be encountered by the examinee. 

4. Response attributes: A set of criteria that either specify the classes 
of responses from which the examinee responds to test items, or specifies 

the standards by which the examinee's responses will be judged. 

5. Specification J supplement 

4.3.6 Checking for Balance and Sequence 

.Taba emphasised the need for curriculum developers to check the congruence 
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Table 10: Test Specifications for a Criterion-referenced Post-test for 
Summative Assessment of Topic 1 



1. General Description ^ ,.• -.^ -.4. u 
The participant reads descriptions about how bil ingual-bicultural teachers 
went about analysing the linguistic content of language level of their 
textbooks, and how bil ingual-bicul tural and multicultural teachers went^ 
about analysing bias in the illustrations or the written content of their 
textbooks. Such analyses formed one basis upon which the teachers selected 
textbooks for use with their classes. In each case, the teachers in the 
descriptions either make specified errors or correctly conduct their analyses. 
The participant will select the error made or indicate that no error was made. 

2. Sample Item 

Directions : fead the description about how a multicultural teacher, named 
Mrs Kamperman, went about analysing and selecting a series of posters of 
people of different cultures she was intending to exhibit on display panels 
in her classroom. 

If Mrs Kamperman makes an error in her behaviour when analysing and selecting 
the illustrations, write on the answer sheet the letter of the response 
alternative that matches the error described. If no error was made, write 
on the answer sheet the letter of that response alternative. 

Mrs Kamperman has been teaching a series of topics about 
the main ethnic groups of migrants — Italians, Greeks, 
Yugoslavs, Germans and Dutch — who settled in Australia 
during the years following World War II. The goal of her 
lessons has been to increase the intercul tural understanding 
of her students about the multicultural nature of Australian 
communities. She believes a display of posters in 
illustrative form which she has collected over several years, 
would reinforce the goal of the lesson. 
Mrs Kamperman examines her collection for examples of 
illustrations of Dutch people who might have settled in 
Australia. She finds only two illustrations of people of 
Dutch origin: an illustration of a Dutch girl wearing 
traditional Marken costume; and an illustration of an 
Afrikaner farmer from South Africa. Mrs Kamperman selects 
the illustration of the Dutch girl wearing traditional Marken 
costume to represent Dutch settlers in Australia. 

How would you judge Mrs Kamperman's selection of an appropriate illustration 
to reflect a Dutch settler in Australia? 

A. Mrs Kamperman made the correct selection. 

B. Mrs Kamperman should have selected the Afrikaner. 

C. Mrs Kamperman should not display either illustration. 

D. Mrs Kamperman should not display either illustration, 
but obtain illustrations from other sources.- 



3. Stimulus Attributes . . 

3.1 Each item will relate to stimulus material containing a fictitious 
description of 200 words or less dealing with a named teacher selecting 
or evaluating curriculum materials. 

3.2 The descriptions will include illustrations of the following 
behavioural factors that may influence selection and evaluation of 
particular aspects of curriculum materials. These criteria apply to 
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particular types of curriculum materials. 

3.2.1 teaching-learning approach: The teaching-learning approach used 
when either the linguistic content or the language level of second 
language material is being analysed. 

3.2.2 linguistic. content: The use of linguistic content must be appropriate 
to the students' language use. 

3.2.3 language level: The language level must be appropriate to the level 
of the students* language use. 

3.2.4 bias in the illustrations: Illustrations in bilingual-bicul tural 
and multicultural curriculum materials must accuraLi^ly reflect the living 
conditions, occupational roles, characterisation and physical features of 
people of a particular culture. 

3.2.5 bias in the written content: Emotive words must be identified to 
eliminate bias in the written content. 

3.3 The description may illustrate completely correct beh'=»viour, or one 
of the behavioural factors illustrated may exemplify erroneous behaviour, 
whereas the remainder of the description exemplifies correct behaviour. 

No more than 20 percent of the test items will exemplify completely correct 
behaviour. 

3.4 The description may include direct quotation of the selector or 
evaluator, as well as descriptions of their actions, 

3.5 If several descriptions are used in a test, the names given to 
selectors or evaluators will be evenly divided between male and female, 
and will include some named characteristic of the most common ethnic 
groups in the population to be tested. The name to be used with the 
description will be chosen at random so that discrimination cannot be 
made on the basis of sex or ethnic group, 

4. Response Attributes 

4.1 The examinees will mark on their answer sheets the letter that 
corresponds to the error made by the selector or evaluator, or the 
statement indicating that no error was made. 

4.2 There will be four alternatives, consisting of the correct response 
and three distractors. The options will include a response indicating 
that no error was made, together with characteristics of one of the 
following behaviours: inappropriate linguistic content; inappropriate 
language use; bias in the illustrations; or bias in the written content. 
The three behavioural factors chosen will correspond to th,ree of the 
factors illustrated in the stimulus material. 

4.3 The correct response will be that alternative that correctly names 
the error illustrated in the description, or, in the case that no error 
was illustrated, that alternative indicating that no error was made. 
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established between the constructs of the curriculum. This involves checking 
that the balance between the objectives, content, learning experiences and 
the means of evaluation matches. Checking should also be undertaken to 
establish the sequence between the elements of the different constructs. 
Moreover, the check should extend to screening the quality of the content so 
that it can be adequately presented in the time available in a workshop. 

Whereas checking for balance and sequence is conducted during the planning 
stage, additional forms of validation are needed before a program is 
implemented. These forms of validation pilot-trial 1 ing, pilot- testing, 
field-trialling or field-testing — should be conducted to determine the 
extent to which the balance and sequence, as well as other features of the 
program, can be verified in educational contexts by applying both objective 
and subjective techniques of evaluation. Such prerequisites for checking 
the balance and sequence of the curricular constructs of a module, that may 
be developed from the program discussed in Chapter 4, need to be met before 
its implementation. 

4.4 Conclusion 

In presenting a proposal for a teacher education program in this chapter, 
the author has not attempted to develop a sequence of modules that can be 
immediately used in a workshop to guide participants through the constructs 
of the curriculum. The program, however, does present the essential form 
for the constructs of the curriculum, whereby modules for a teacher education 
course can be developed. 

The program is intended to be used by a curriculum developer to design modules 
that will match specific educational contexts for which they are intended. 
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The author believes that a curriculum developer, undertaking such an activity, 
would be expected to take account of the different models and approaches for 
implementing the teacher education program as discussed in Chapter 5. 
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5. IMPLEMENTATION OF THE PROPOSAL FOR A TEACHER EDUCATION PROGRAM 



5.1 Teacher Education in Tasmania 

The National Inquiry into Teacher Education (1980) has described the nature 
and provision of inservice teacher education in Australia. The committee 
responsible for this report identified three types of inservice education: 
formal award-based inservice courses, including degree and diploma courses, 
at tertiary institutions; non-award-based inservice courses of two types — 
non-award-based courses and short, 'once only' activities; and informal 
inservice education -— home-school liaison, work with community organisations 
work experience and professional reading. This situation is substantiated 
by the series of reviews of teacher education conducted in most Australian 
states: Queensland (Committee appointed by the Board of Advanced Education 
and the Board of Teacher Education, 1978); New South Wales (Committee to 
examine Teacher Education in New South Wales, 1980); South Australia 
(South Australian Enquiry into Teacher Education, 1980); Western Australia 
(Committee of Enquiry into Teacher Education, 1980); and Victoria (Committee 
of the Victorian Enquiry into Teacher Education, 1980). 

Unlike other Australian states, there has been no official inquiry into 
teacher education conducted in Tasmania. Despite this, the development 
of teacher education in Tasmania has shown distinctive characteristics 
which have not occurred in other Australian states. The activity of the 
state education department in inservice teacher education in Tasmania is dividi 
into two main divisions: the Centre for Continuing Education of Teachers, 
which provides formal award-based degree courses through tertiary institutions 
and General Programs, which provide non-award-based programs of both short 
activities and longer courses. The development and nature of each of these 
divisions are examined below. 
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b.1.1 The Centre for Continuing Education of Teachers 

The Centre for Continuing Education of Teachers is a cooperative agency 
representing a collaborative use of personnel and resources between the 
Education Department of Tasmania, The University of Tasmania and the 
Tasmanian State Institute of Technology. A board of management composed 
of equal representation from these three institutions, together with 
representatives from teachers' unions and independent schools, is responsible 
for determining policies. An executive committee comprising board 
members from each of the institutions is responsible for implementing 
these policies. 

The Centre for Continuing Education of Teachers evolved from an informal 
linkage between teachers colleges and the Education Department of Tasmania, 
which together provided inservice teacher education courses for requirements 
of minimum certification. In 1967, the Teachers Cc' " - ?s Board of Studies 
assumed responsibility for administering and coordinating these courses. 
Between 1968 and 1980, the program of courses was expanded, and when the 
Tasmanian College of Advanced Education (now the Tasmanian State Institute 
of Technology) assumed responsibility from the teachers colleges for 
preservice education of teachers, a collaborative arrangement was established 
between this institution and the Education Department of Tasmania. 
During 1979 and 1980, rationalisation of teacher education occurred in 
Tasmania through the creation of the Centre for Education at the University 
of Tasmania. The Centre for Education incorporated the division of 
teacher education of the Tasmanian College of Advanced Education in southern 
Tasmania, formerly located at Mount Nelson, and the faculty of education 
of The University of Tasmania. This development led to The University of 
Tasmania becoming involved in inservice education through the Centre for 
Continuing Education of Teachers, and a tripartite collaboration between 
these three institutions was established and has continued. 
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The courses offered through the Centre for Continuing Education of Teachers 
are developed through advisory committGes. Once needs are defined by 
schools, subject associations or tertiary institutions, the board of 
management initiates development of courses. Advisory committees, 
consisting of representatives from tertiary institutions and teachers, 
prepare course outlines containing statements about intents, contents, 
methodologies and references. Once accepted by the board of management, 
course outlines are referred to tertiary institutions for accreditation. 
A similar procedure is adopted for periodic review of all subjects. 

Courses developed through this process consist of three types: foundation 
studies; advanced studies; and a senior staff development program. 
Foundation studies consist of approved subjects for qualification in the 
Tasmanian Teachers Certificate. Advanced studies, consisting of the bulk 
of the courses, are designed for qualification in a bachelor of education 
degree. Although they do not run concurrently, advanced studies' coursework 
subjects have been developed and implemented for thirty-seven subjects. 
The Senior Staff Development Program comprises of courses designed for 
qualification in either a bachelor of education degree or a master of 
education degree. Subjects have been developed and implemented for 
for five courses. These courses are listed in Appendix . 

An important feature of the provision of these courses is their offering 
at all major urban centres in Tasmania. Most courses are regularly 
offered in the two major cities in Tasmania: Hobart, the state capital, 
situated in southern Tasmania; and Launceston, situated in northern 
Tasmania. Courses are also offered at other major towns: Burnie, 
Devonport, Ulverstone, Smithton, Scottsdale, Queenstown, Rosebery, and 
Huonville. 
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5.1.2 General Programs 



General programs can be grouped into three types: the School Improvement 
Program; short courses; and public service staff development activities. 
The School Improvement Program, introduced in 1982, funds school-based 
projects within guidelines specified by the Commonv/eal th Schools Commission. 
The major features of such projects are that they provide an adult learning 
experience; develop participants' knowledge* skills and a.ttitudes; involve 
a school community; specify a rationale, objectives, methodologies, and a 
means of evaluation; can be completed within a school year; and can be 
maintained by the school without assistance. 

Seminars provided through short courses are generally organised at regional 
teachers centres in Tasmania. These short courses are also linked to 
guidelines and funded by the Commonwealth Schools Commission. 

Public service staff development activities involve a combination of 
formal award-bearing courses provided through tertiary institutions by 
the Assisted Study Program, and short courses. Short courses are designed 
for organisational, group and individual irservice development. 

5.2 Models and Approaches for Teacher Education 

Three models and three approaches are presented in this paper for implementing 
a training workshop that has been developed from the teacher education 
program proposed in Chapter 4. 

The three models are termed in this paper: the formal award-bearing model; 
the informal non-award-bearing model; and the tutor-training model. The 
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formal award-bearing model will be examined in the context of the program 
offered by the Centre for Continuing Education of Teachers in Tasmania, 
whilst the informal non-award-bearing model will be examined in terms of 
the general programs provided through the Education Department of Tasmania. 
The third model, termed tutor- training, will be considered in light of 
reviews of its implementation in reading programs in New Zealand and 
Austral ia. 

These three models for implementing a teacher education program have been 
selected because they have been implemented, or are being implemented, 
generally by academic institutions and educational agencies in Australia. 
The three models represent only 'a small proportion of techniques for 
implementing teacher education programs. Two models for implementing 
teacher education programs, that have been recently developed in the United 
States, are discussed below because of their implications for application 
to implementing inservice teacher education for selecting and evaluating 
curriculum materials. 

The Educational Products Information Exchange Institute (1986b) states that 
its policy for utilisation of educational materials should be implemented 
through a planned model for teacher education, such as proposed by Joyce 
and Showers. (1983). In this model, Joyce and Showers propose that five 
elements should be included in the training process: forecasting the problem 
of transfer of skills to the workplace; developing very high degrees of 
skill prior to classroom practice; providing the skill to select an 
appropriate strategy for application of skills in the classroom; providing 
for practice in the workplace immediately following skill development; and 
providing for 'coaching' by peers where skills learnt must be adapted to 
conditions in the workplace. 
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Hunter (1983) has developed a model, known by several names — A Clinical 
Theory of Instruction, Mastery Teaching, Clinical .Teaching, Target Teaching, 
the UCLA model or the Hunter model — which can be specifically applied to 
increase the effectiveness of the skills teachers use to select and to 
evaluate materials for classroom use. The explicit supervisory aspect of 
this model could be applied to monitoring teachers' applications to selecting 
and evaluating curriculum materials through development of an assessment 
instrument akin to the Teaching Appraisal for Instructional Improvement 
Instrument, developed by Hunter to diagnose professional performances of 
teachers. 

The three approaches are termed in this paper: the curriculum studies approach; 
the subject-oriented approach; and the mul tidisciplinary, team teaching 
approach. The rationale and development for each of these approaches are 
discussed below. 

A curriculum studies approach endeavours to adopt a generic approach to the 
selection and the evaluation of curriculum materials without direct reference 
to content areas, whilst a subject-oriented approach is specifically confined 
to the characteristics of the selection and the evaluation of curriculum 
materials within a particular content area. The limitations of both these 
approaches, representing polarised positions, had prompted Eraut aJi. to 
propose a mul tidisciplinary, team teaching approach, which provides a 
compromise by applying subject-oriented expertise through team teaching. 

In the discussion about each model, application of a curriculum studies 
approach, a subject-oriented approach or a mul tidisciplinary, team teaching 
approach, will be considered. Discussion of the subject-oriented approach 
within each of the three models will be directed to consideration of the 
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selection and the evaluation of curriculum materials for bilingual- 
bicultural education and multicultural education. 

5.2.1 The Formal Award-bearing Model 

Despite the predominant position of formal-award bearing courses in teacher 
education programs in Australian, as well as overseas, educational institutions 
few examples of formal award-bearing courses that aim to develop teachers' 
knowledge and skills about selecting and evaluating curriculum materials 
have been documented. Morrissett zt al. report instances of the use of the 
CanAlcuZm MatoAAjxLi AnaZy^-U Sy6tm for training evaluators of curriculum 
materials conducted at Purdue University and the University of Colorado. 
As reported by Hechinger (1980), fewer than five percent of over 120 teacher 
training institutions in the United States surveyed by the Educational Products 
Information Exchange Institute offered courses to train teachers to select 
curriculum materials. Eraut &t al. provide detailed information about the 
higher degree program for evaluating curriculum materials offered at the 
University of Sussex, England. 

Each of the three approaches could be applied to implementing a course for 
selecting and evaluating curriculum materials within a teacher education 
program adopting a formal award-bearing model. Within this paper, the 
subject. Language Development and Multicultural Education, offered by the 
Centre for Continuing Education of Teachers in Tasmania, has been chosen 
as a suitable course for discussing implementation of a subject-oriented 
approach. Each approach will be discussed separately in the context of 
the teacher education program offered by the Centre for Continuing Education 
of Teachers. 
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5.2.1.1 The Curriculum Studies Approach 

The difficulties of successfully implementing a curriculum studies approach 
to the selection and the evaluation of curriculum materials in a teacher 
education program have been referred to in the discussion about the formal, 
award-bearing course at Sussex University described by Eraut ojt al. 
Despite the likelihood of a curriculum studies approach degenerating either 
towards superficiality or elevating towards theoretical considerations, 
it is possible that this approach would be seen as appropriate to the 
departmental organisation of most tertiary institutions in Australia. 

However, given the orgariisation of courses provided by the University of 
Tasmania and the Tasmanian State Institute of Technology through the Centre 
for Continuing Education of Teachers, it seems that application of this approach 
would be less appropriate than the alternative approaches. It should be 
noted, as reported in section 4.2.1, that this approach was overwhelmingly 
rejected by the coordinators of courses offered through the Centre for 
Continuing Education of Teachers. 

The author believes that the teacher education program presented in 
Chapter 4 could be implemented through a curriculum studies approach within 
a formal, award-bearing context if the reservations noted by Eraut at al. 
are taken into account. To avoid the course degenerating toward 
superficiality or elevating toward theoretical considerations, features from 
other approaches the presentation of curriculum analysis through both 
team teaching within different subject areas, and course coordination 
within the generic aspects need to be amalgamated in a curriculum studies 
approach. 
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5.2.1.2 The Subject-oriented Approach 



It would be feasible for the subject-oriented approach, preferably modified 
by the conclusions derived from writers discussed in this document, to be 
adopted in the course. Language Development and Multicultural Education, 
offered through the Centre for Continuing Education of Teachers. 

The course is presently content-oriented and consists of three topics: 
the first titled the ethnic dimension; the second titled approaches to 
language study; and the third titled teaching Engl ish-as-a-second-language. 
Within the third topic, some attention is given to curriculum materials 
used in the teaching of Engl ish-as-a-second-language. Certain dimensions — 
those appropriate to the needs of teachers of Engl ish-as-a-second-language — 
of the topics developed as part of the content of the teacher education 
program presented in Chapter 4, could be adapted for implementation in the 
course as a means of developing participants' skills to select and evaluate 
curriculum materials for Engl ish-as-a-second-language programs in Tasmanian 
schools . 

5.2.1.3 The Mul tidiscipl inary, .Team Teaching Approach 

Eraut al. report the successful implementation of a multidiscipl inary, 
team teaching approach within a one-week workshop, part of a formal award- 
bearing course at the University of Sussex. As a result, this group 
declared that five guidelines should be followed in curriculum analysis 
workshops: firstly, that analysis should be conducted in small groups; 
secondly, that the participants' choices of materials should be based on 
their needs; thirdly, that participants should complete the first draft of 
an analysis within the week; fourthly, that structured input from the workshop 
leader should be minimal; and lastly, that the role of the workshop leader 

... 106 

154 



should be that of a process-helper rather than an expert. 

Advocacy of a small group, participant-centred form of the mul tidisciplinary, 
team teaching approach is valid when an instrument such as the Sussex Scheme, 
which applies an interaction model for curriculum development to the 
analysis of curriculum materials and an emphasis upon the decision making 
function, is used in a workshop. It may not be appropriate, however, 
when instruments, such as the CuMjUcuZum Uiotzn^aJU Analy^l^ Sy^tm used by 
the Social Science Education Conso^^tium or versions of EPIEform A used by 
the Educational Products Information Exchange Institute, that apply an 
objectives model for curriculum development to the analysis of curriculum 
materials, are used in a workshop. 

The teacher education program presented in Chapter 4 has been developed so 

that it may be implemented in a workshop by means of a mul tidiscipl inary, 

team teaching approach. Curriculum analysis within different subject areas 

is to be introduced to small groups of participants through the mul tidisciplinary 

team teaching approach in Topic 1. Participants are to be selected on the 

basis of their expertise in a subject area for inclusion in a small group. 

The guidelines developed by Eraut et at. can be adhered to in the presentation 

of Topic 1 although participants are not required to complete an analysis 

of a curriculum material within a specified time limit, but rather to complete 

the designated exercises for Topic 1. 

Topic 2, Topic 3 and Topic 4 are oriented towards the generic aspects of 
selecting and evaluating curriculum materials. Although it is appropriate 
for the team leader in the teaching team to present the content of each of 
these topics to the participants, expertise in particular subject areas 
should be applied to focus upon the practical aspects of the selection and 
the evaluation of curriculum materials. 
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5.2.2 The Informal Non-award-bearing Model 



The informal non-award-bearing model has only been applied to 'once only', 
short courses of one to five days duration, in the inservice teacher 
education program in Tasmania. In this situation, these courses have been 
introductory in nature. 

The informal non-award-bearing model should only be applied to introductory 
courses directed to teacher education in selecting and evaluating curriculum 
materials. Such a course, however, could play a significant part to 
introduce techniques for selecting, adopting, utilising and evaluating 
curriculum materials to Australian teachers. This is likely to be most 
successfully achieved if introductory 'stand alone' modules are developed 
for each of these topics, as part of a more intensive teacher education 
program. 

Both the curriculum studies approach and the subject-oriented approach 

could be applied, once such introductory 'stand alone' modules had been 

developed. The curriculum studies approach would be best suited to 

a short, one- or two-day workshop, to introduce techniques for selecting, 

adopting, utilising and evaluating curriculum materials. On the other 

hand, the subject-oriented approach is more appropriate for introducing 

to groups of teachers, each of whom possesses expertise in the same subject 

area, techhiques and characteristics for selecting and evaluating curriculum 

materials that apply specifically to their subject area. For instance, 

the subject-oriented approach may be applied to develop a short, 'stand alone' 

module that would encompass Topic 1 of the teacher education program presented 

in Chapter 4. Since the multidisciplinary, team teaching approach is most 

suited for use in workshops that are part of an extended teacher education 

program of not less than a week's duration, this approach is probably less 
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adaptable to use in the informal non-award-bearing model, as this model is 
applied in Tasmania and other Australian states. 

5.2.3 The Tutor Training Model 

The tutor training model, proposed in this paper as a means for developing 
and implementing a teacher education program to improve teachers' skills in 
the selection and the evaluation of curriculum materials for bilingual- 
bi cultural education and multicultural education, had its origins in 
inservice programs developed and implemented nationally in New Zealand. 
These programs are the Early Reading Inservice Course directed to the 
early childhood level, the Later Reading Inservice Course directed to the 
middle and upper years of primary schooling, and Reading Recovery directed 
to children at risk in reading development. 

The first two programs were implemented during 1978. Teacher education 
is a predominant feature of each. Hill(n.d.) has reported upon the 
important characteristics of teacher education involved in each program. 
Hill indicates the following characteristics of teacher education associated 
with the Early Reading Inservice Course. 

'The ERIC course consists of twelve units of work 
taken at weekly intervals. Each unit is designed 
to be viewed individually, at a specifically prepared 
centre, where multiple copies of each unit and 
audio visual facilities are available. The program 
consists of slides, film strips, tapes and booklets 
' (Hill, 12). 

This teacher education aspect of the Early Reading Inservice Course appears 
to have been particularly successful. Following, an evaluation of the 
program. Turner (1982) reported that more than ninety percent of New Zealand 
teachers of junior classes had participated in the course. 
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Hill indicates the following characteristics of teacher education associated 
with the Later Reading Inservice Course developed at the Christchurch 
Teachers College, South Island, New Zealand. 
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*LARIC consists of ten units of work presented by 
trained tutors at weekly intervals to groups of up to 
ten teachers at small centres or in classrooms. 
A large part of the LARIC program focusses on teaching 
demonstrations on video tapes and teaching practice 
decribed in unit booklets. The videos were made of 
teachers in many parts of New Zealand in rural and 
urban schools. The LARIC program consists of teachers 
viewing the video tapes, discussing classroom practice 
with other classroom teachers and with the tutor. 
The content of the unit booklet is discussed in groups; 
then unit activities and relevant readings are taken away 
for further reading and application in the classroom' 
(Hill, 14). 

Reading Recovery was first introduced to Auckland schools during 1979. 
The program aims to diagnose reading difficulties of children who have 
the lowest level of achievement at their sixth birthday. Specific teaching 
techniques are then implemented to improve the performance of identified 
children. Like the Later Reading Inservice Course, the tutor training 
model has been fully implemented to train Reading Recovery teachers. 

As a result of New Zealand experience with these courses, an Early Literacy 
Inservice Course was developed and implemented by the Education Department 
of South Australia during 1983-1984. The Early Literacy Inservice Course 
retains several similarities to the teacher development practices of the 
New Zealand programs. Hill lists the following principles for teacher 
education: theory is presented as the underpinning of practice; the program 
builds on,' arid recognises, existing practices; staff in leadership, positions 
are to support the program's implementation; a network of tutors, who are 
classroom teachers, support teachers in their schools; involvement by a 
groups of teachers from the same schools in the program; the use of a variety 
of media in presenting the course; effective tutor training; and teachers 
becoming learners and researchers. 
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In 1984, a tutor training program, similar to the Later Reading Inservice 
Course in New Zealand, was implemented and evaluated in South Australia. 
The teacher education program is designed to operate at two levels: the 
training of tutors; and the training of teachers, A tutor's manual, a set 
of overhead transparencies, unit booklets, video tc.j^es and audio tapes have 
been developed for use in the teacher education program. The modifications 
ensuing from the evaluation formed the basis for national implementation of 
the program in all Australian states and territories durinr 1985, excepting 
in Queensland and Western Australia which opted to develop alternative 
programs • 

Extension of the tutor training model outside reading development has not 
been reported. However, the nature of the tutor training model lends itself 
to adaptation for teacher education in selecting and evaluating curriculum 
materials particularly in geographical circumstances of sparsely distributed 
or undeveloped educational resources. The capability of the two levels of 
teacher development in the tutor training model to be used to communicate, to 
train and to disseminate materials to a large number of teachers at low cost 
is its conspicuous feature. The model is particularly apt to the practices 
of bilingual-bicultural education in the United States, Canada and Australia 
where a considerable proportion of non-English speaking groups, to which these 
programs are directed, live in the most remote and sparsely serviced 
local ities. 

The characteristics of the tutor training model determine the extent to which 

each of the three approaches can be applied to developing and implementing 

a teacher education program in selecting and evaluating curriculum materials. 

Each of the three approaches can be applied, preferably in combination, to 

the tutor training model. Both the curriculum studies approach to curriculum 

analysis and the subject-oriented approach to curriculum analysis can be 
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applied at each level of the tutor training model. The multi disciplinary, 
team teaching approach, however, seems particularly suited to the training 
of tutors which will occur at a central service centre. On such occasions, 
teams consisting of members with expertise in either curriculum analysis or 
a subject area can be . 3ed to 'rain the tutors. Since the tutors are 
required to train groups of teachers, often in a situation that is isolated 
from an education service centre, they will need to draw upon aspects of 
both a curriculum studies approach and a subject-oriented approach. 

5.3 Conclusion 

Since the number of models and approaches that can be applied to implement 
a teacher education program is unlimited, it was essential to restrict the 
number considered. Only those models and approaches that the author knew 
had been implemented, or are being implemented, in Australia were examined. 
Techniques for teacher education developed in the United States, such as the 
models of Joyce and Showers or Hunter, were mentioned in relation to their 
current application in teacher education by the institutions discussed in 
Chapter 3. These models, however, provide valid techniques for presenting 
a teacher education program in selecting and evaluating curriculum materials. 

The discussion presented in this chapter, however, is speculative. Although 
the author has presented arguments supporting or opposing the use of each of 
the models or approaches for successfully implementing a teacher education 
program in selecting and evaluating curriculum materials, the validity of 
of each model or approach cannot be judged until it is actually implemented 
in a teacher' education program. This has not yet been attempted in Australia. 
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6. CONCLUSION 



The preceding chapters of this paper have shown that some attention has 
been given to developing criteria and applying these criteria to evaluating 
curriculum materials for bilingual-bicultural education and multicultural 
education. The search for literature in this field and its subsequent 
analysis, indicated that most, if not all, the activities related to 
evaluating curriculum materials for bilingual-bicultural education and 
multicultural education have been undertaken in the United States. It 
was found that most activities had been conducted by two institutions: 
the Educational Products Information Exchange Institute and the Social 
Science Education Consortium. 

The need for a systematic approach to selecting and evaluating curriculum 
materials for bilingual-bicultural education and multicultural education 
programs in Australian schools was stated by the Curriculum Development 
Centre (1980). There is little evidence to support a view that action 
has been taken in Australia to plan, implement and conduct selections and 
evaluations of bilingual-bicultural and multicultural curriculum materials 
that meet the standards recognised by overseas educational agencies 
specialising in this field. 

The search through the databases of the Educational Resources Information 
Center also indicated that a large number of state educational agencies in 
the United States have developed guidelines for selecting and evaluating 
curriculum materials. Since most state governments in the United States 
have enacted legislation to establish and conduct textbook adoptions, 
selection committees have been formed and have applied such guidelines to 
textbook adoptions. In only one Australian state. South Australia, have 
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guidelines been published for evaluating curriculum materials (Education 
Department of South Australia, 1984). These guidelines are intended to be 
applied to educational products developed by that agency and not to textbook 
adoptions. It can be concluded that, unless the critical issues for 
selecting, evaluating, adopting and utilising curriculum materials are more 
widely recognised by Australian educators, the prospect that these issues 
will be systematically addressed in the future, is unlikely. 

Despite this conclusion, the potential to develop new services, or to modify 
existing services, in Australian education to deliver information about 
evaluations of curriculum materials undoubtedly exists. Recently, two 
developments in educational technology in Australia enhance the capacity 
to deliver these services to Australian schools if the issues, mentioned 
above, are recognised, tackled and acted upon. These two developments are, 
firstly, the planning and current implementation of the Australian Schools 
Catalogue Information Service, and secondly, the tentative planning for a 
national software dat . e and clearinghouse. Although these initiatives 
are developing independently, the incorporation of valid standards and 
criteria to evaluate curriculum materials within the Australian Schools 
Catalogue Information Service and computer software in the national software 
database, would provide a basis for their rational integration. The 
nature and present extent of development of each of these initiatives are 
now discussed. 

The Australian Schools Catalogue Information Service has been established 
to provide cataloguing services for Australian schools nationally, through the 
collaboration of state education departments, the National Catholic Education 
Commission, National Council of Independent Schools and the Commonwealth 
Schools Commission. In its report, the Australian Schools Catalogue 
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Information Service (1986) states that the database and the systems for 
microfiche and catalogue card production have been developed and implemented. 
Presently, machine-readable catalogue records in AUSMARC tagged format are 
being delivered onto floppy disk. The Western Australian Educational Computing 
Consortium (1986) reports that, in addition to bibliographic data, as many 
as fourteen abstracts can also be entered for each item. These fields have 
been used to include evaluations of curriculum materials based upon those 
provided in Scan, the journal of the Library Services, New South Wales 
Department of Education and the New South Wales Curriculum Information Network. 

In 1984, the Curriculum Development Centre funded the Western Australian 
Educational Computing Consortium to conduct a feasibility study to investigate 
developing and implementing the evaluation and cataloguing of educational 
software used in Australian schools. The project officer, John A. Winship, 
reviewed the current situation in Australia and undertook a study tour, 
visiting educational institutions in Canada, the United States and the 
United Kingdom. In the report, the Western Australian Educational Computing 
Consortium recommended that a national software clearinghouse be established, 
which would administer a database to provide information, reviews and 
evaluations of computer software for Australian schools. It was also 
recommended that state and local centres, involved in computer education, 
would support and assist the dissemination of reviews and evaluations 
provided by the national software clearinghouse. 

In their reports, both the Western Australian Educational Computing Consortium 
and the Curriculum Development Centre foresaw the need to involve 
international experts to advise about the planning, the implementation and 
the conduct of the evaluation of computer courseware, in the first case, 
and bilingual-bi cultural and multicultural curriculum materials, in the 
second case. There has, it seems, been little attempt by Australian 
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educational Institutions Involved In these activities to initiate such 
contacts overseas with the aim of facilitating the development of these 
services. 

Komoski indicates (personal communication) that *if an appropriate 
Australian educational institution wished to work with ERIE to extend its 
services to serve the needs of Australian schools, EPIE would be very 
Interested in exploring the means through which this could be done'. 
Since both of the Australian developments reported above are presently 
only at an initial stage of development and implementation, in the first 
case, and at a preliminary stage of development, in the second case, it 
may be feasible to incorporate services developed by an overseas educational 
agency, such as EPIE Institute, within either of these developments. 

In contrast, the literature search and its subsequent analysis revealed that 
there was a paucity of professional materials that could be implemented 
in teacher education programs to promote improvement in the selection and 
the evaluation of curriculum materials. Further research indicated that 
few universities or other institutions of higher learning provided such 
programs. It was found that several of the most important developments 
to provide teacher education for selecting and evaluating cur n'culum 
materials were being conducted by the Educational Products Information 
Exchange Institute. 

It must be concluded that teacher education for improving the quality of 
selections and evaluations of curriculum materials has been particularly 
neglected. The prospect for improving this situation in Australia, as 
elsewhere, is not promising unless teachers can be persuaded that valid 
techniques should be developed or extended, and then applied to selecting 
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and evaluating the instructional materials they use with students in their 
classrooms. The work of such institutions as the Social Science Education 
Consortium and the Educational Products Information Exchange Institute do, 
however, hold the promise that both the techniques for selecting and 
evaluating curriculum materials and the development of teacher education 
programs can be promoted if the activities of these institutions become 
better known among Australian educators. 
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EJ 283 228 

Zenke, L. and LaPota, M. 

1983 School book selection: procedures, challenges, and responses 
lnQl<^h JouAnat, 72: 4, 36-38 
EJ 277 880 

1,2 Studies 

Atkins, C. P. and Carline, J. L. 

1980 Reading materials in public schools: selection and controversy 
CoYitmpohjoJiy EdaccutLon, 51: 4, 182-185 

EJ 235 446 

Cambre, M. A. 

1981 Historical overview of formative evaluation of instructional media 
products 

Edixcationat Commuif Location and Technology: A Jou/inaZ Theory, Rz^za/ich, 
and VzvQJiopmznt^ ?9: 1, 3-25 
EJ 246 044 

Kamhi, M. M. 

1982 Censorship vs. selection: choosing books for schools 
AmoJUcan EducaX^on^ 18: 2, 11-16 

EJ 262 771 

Kandaswamy, S. 

1980 Evaluation of instructional materials: a synthesis of models and 
methods 

EducatlonaZ Tzcknology^ 20: 6, 9-26 
EJ 228 324 

Parker, B. 

1981 Disparate ways of selecting texts 
ExzcLuUvz EduLcatoH,^ 3: 12, 27,34 

EJ 255 055 
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2. Teacher education 
2.1 Studies 



Marsh, C. J. 

1983 Curriculum materials analysis in social studies methods classes 
Social Studtu , 74: 3, 107-111 
EJ 284 693 

3. Bilingual-bicultural and multicultural education, and related areas 
3.1 Methodologies 

Acosta-Belen, E. and Sjostrom, B. R. 

1979 Aula/':he classroom: guidelines for the evaluation of instructional 
materials for sexism and racism 

NABE: Thz Journal thz HatA^onaJi k^^odiatlon f^OK BlU^maat Education^ 
4: 1, 81-91 
EJ 218 348 

Asman, D. 

1983 The hidden agenda 

Amz/LLcan Idacaton,: Thz ?n.o {^z^^lonaJi 3oa/iYiaZ thz AmoAlcan fzdQAatlon oi 
Tza(ih(LhJ> ,7:1, 16-19 
EJ 278 967 

Bennett, C. T. et al . 

1984 A conceptual framework for selecting and evaluating multicultural 
educational materials 

3oix/mal SocUal Stud^u RoAzcuich, 8: 2, 39-52 
EJ 316 041 

Bertoletti, M. C. and Dahlet, P. 

1984 Manuels et materiels scolaires pour 1 V:ipprentissage du F.L.E. 
Ebauche d'une grille d'analyse (Study guides and instructional materials 
for learning French as a foreign language. Outline of a grid for analysis) 
fnjancciU dayu Iz Hondz^ 186, 55-63 
EJ 302 920 

Breiter, J. 

1981 Evaluating materials for gifted education: opportunity knocks 
G/C/T, 16, 26-29 

EJ 240 553 

Breiter, J. 

1982 Evaluating classroom materials for gifted children 
Roept'A Reu^etu, 5: 1, 17-18 

EJ 274 485 

Brimble, R. A. 

19B1 A guide to selecting reading materials 
kii^t/iaZlaYi Jou/inat of^ Rzading^ 4: 4, 173-178 
EJ 259 307 

Carter, D. A. 

1983 Selecting resources for the multicultural classroom 
Mormyitm^ 14: 1, 47-49 

EJ 287 047 
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1933 ERIC/RCS: secondary reading materials: selection criteria for the 
classroom teacher 

Journal 0(5 Rtadlng, 26: 8, 734-736 
EJ 279 j59 

Cohen, S. B. et al . . . . 

1979 Selecting and developing educational materials: an inquiry model 
Te.achA.n3 ExczptAonat ChltdAtn, 12: 1, 7-11 

EJ 214 329 

Gilles, J. . . -, 

1980 Preferred picks: materials for classroom teachers with special 

students 

PoZyutoA, 24: 3, 82-87 
EJ 234 280 

Hicks, D. 

1981 Teaching about other peoples: how biased are school books? 
EducaUon 3-15, 9: 2, 14-19 

EJ 253 264 

International Reading Association 

1981 Checklist for evaluating adult basic education reading material 
Jounnal 0|$ Rzading, 24: 8, 701-706 

EJ 245 627 

Josel , N. A. 

1982 Public library material selection in 6 bilingual community 
Catholic Ub/mAy WonZd, 54: 3, 113-115 

EJ 273 015 

Moffet, J. B. 

1982 Student interest and p'^rtinence of content in selecting reading 
material s 

Rzadlng Jmp^vejnmnt, 19: 4, 310-312 
EJ 271 071 

Pennington, C. R. 

1984 Evaluating books for the gifted reader 
G/C/T, 34, 15-18 
EJ 306 835 

Rice, G. and Rice, G. H. 

1982 A selection guide for elementary social studies textbooks 
Social StixcUu, 73: 2, 61-67 
EJ 262 496 

Roberts, A. D. 

1980 The Roberts' checklist: selecting and evaluating social studies 
material 

Social Stadiu, 71: 3, 114-117 
EJ 226 490 
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Rothe, J. P. , . .-ij-j- ►^^rt^^,^ 

1982 Helping teachers analyze basic structures in social studies program 

materials 

Hi&tofiLj and Social Science TaachcA^ 17: 3, 147-153 
EJ 260 556 

Sciarone, A. G. ^ , , . 

1979-1980 Valutazione del libri di testo per le lingue strannere (Italiano 
L2) (Evaluation of foreign language textbooks (Italian as a second language)) 
Roi^egna TtaUana di UngiLUtica. kppUcata, 11: 3/12: 1, 145-172 
EJ 232 323 

Singer, M. G. and Pass, B. H. • . u 

1982 Beyond advertising: how to choose materials for review and purchase 

Acadenu-c TkoAapy, 17: 3, 323-327 
EJ 259 588 

Stieglitz, E. L. 

1982 A rating scale for evaluating English as a second language reading 
material 

JoiUinaZ oi RzadlnQ, 26: 3, 222-228 
EJ 271 134 

Tu rriG r T • N • 

1981 'values questions and selecting reading materials 
Tenne44ee Edaca^on, 11: 2, 18-20 
EJ 260 239 

Wood, D. . . ^ 

1981 Social studies textbooks in a multicultural society 
HiMon.1] and the. Social Science TeacheA, 17: 1, 21-29 
EJ 262 461 

3.2 Studies 

Bindel, J. 

1983 Bilingual /multicultural science resources 

NA8E: The. Jounnal ion. the Ma;Uonal AA^ocMvUon ion. BlUnguaZ EdacaX^on, 
8: 1, 23-28 
EJ 307 287 

Brimble, R. A. 

1981 Who selects reading materials? 
^u6PlaJUan Jounnal oi Reading, 4: 4, 199-202 
EJ 259 310 

Butterfield, R. A. .... 

1979 Multicultural analysis of a popular basal reading series in the 
International Year of the Child 

JouAnal oi Megn.0 EdixcaZlon, 48: 3, 382-389 
EJ 210 332 

Garcia, J. . ^ • j. j. • 

1980 Toward more effective methods of evaluating ethnic content in 

curricular materials 

lJUUnoU School Rz^eaAch and VeveZopment, 16: 2, 41-48 
EJ 226 944 
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Gonzales, P. C. 

1983 An analysis of language development materials 

WABE: Tho, Journal ion. thz HationaZ A660(U(vtlon ion, B^itinguaZ Edacatioriy 

8: 1, 5-21 

EJ 307 286 

Grant, C. A. and Grant, W. A. 

1981 The multicultural evaluation of some second and third grade textbook 

readers: a survey analysis 

JouAnat oi HzQn,o EdacouUoyij 50: 1, 63-74 

EJ 241 624 

U.S. Commission on Civil Rights 
1980 Selecting bias-free texts 
Today U EdaccuUoyiy 69: 3, 86-87 
EJ 237 781 

Wiedrick, L. G. 

1979 Sources for selecting Canadian elementary school materials 
Elmtyvt^: TAayutcuUng Thzon^y Iwto P/iaaticz^ 11: 2, 4-6 
EJ 213 635 
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APPENDIX 4: BIBLIOGRAPHY OF JOURNAL ARTICLES IN THE BRITISH EDUCATION IWPEX 
British Library Bibliographic Services Division, London, England 

1. General 

1.1 Methodologies 

Blanchard, B. E. 

1983 The Illinois Index for selecting textbooks 
Scimtia Vatdagoglca Ex.pz/iirmnt(itL6 , 20: 2, 161-175 
20, 351 

Oldham, B. E. 

1981 Selection: the greatest responsibility 
School LWiCUUan, 29: 1, 6-11 

17,266 

Williams, D. 

1983 Developing criteria for textbook evaluation 
EngtUh Languagt Ttaching Jou/inat, 37: 3, 251-255 
20, 350 

1.2 Studies 
Mariet, F. 

1980 The social conditions for a selection of instructional audio-visual 
media 

Ea/LOpean JouAnaZ o^ Education^ 15: 3, 241-249 

17, 24 

2. Bil ingual-bi cultural and multicultural education, and related areas 
2.1 Methodologies 

Davey, M. 

1982 Choosing and using oral materials 

Jou/inal, A6^ocA.ation o^ Tzachah^ oi Italian^ 37, 43-46 
19, 347 

De Rome, D. 

1982 The selection and use of authentic written material for adults 
Jou/inaZ, A64iOCA.cution o<J Ttachdn^ oi ItaLLan^ 57, 22-31 
19, 347 

Fenwick, G. 

1981 Finding out about children's literature 
Unk^, 7: 1, 28-31 

18 

Hicks, D. 

1981 Teaching about other people: how biased are school books? 
EduccuUon 3-J3, 9: 2, 14-19 

18, 323 

Maingay, S. M. 

1980 Selection and grading of authentic material for the reading class 
EngJLuh Languagt Tuacking Joa/ma£, 34: 3, 217-221 
17, 266 
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Raddan, A. 

1984 Selecting non-fiction books for a multi-ethnic society 
School LibfLOL/Uan, 32: 1, 20-24 

21 

Sandford, H. A. 

1983 CrHeria for selecting a school atlas 
Te-adiing Gzogfiaphy, 8: 3, 107-109 
19, 346 

Wilson, J. 

1982 Choosing information books 

Signal, 39, 163-168 

20 

2.2 Studies 
Marsh, C. J. 

1985 Teachers' perceptions about the selection, distribution and use 
of social studies and mathematics curriculum materials within a state 
education system 

JouAnal 0(5 CuAM.auZum Studlu, 17: 1, 49-61 
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APPENDIX 5: BIBLIOGRAPHY OF NONJOURNAL WORKS IN THE, AUSTRALTAW BVUCATION IWPEX, 
The Australian Council for Educational Research, Hawthorn, Victoria 3122, 
Australia 

1. General 
Franzel , A. 

1982 Selecting books 

In: Noel, E. (ed.), Ab£e to anjoiji book6 and tlit //oung, 85-93 
Sydney : IBBY Australia 
25: 3128 

Hill, S. 

1983 Who selects the books? A discussion and case study of a literature 
program in a primary school 

In: Hutchins, J. zt a£.(eds.). Shaping thz cuMlculm, 1, 17.1-17.10 
Adelaide: South Australian College of Advanced Education 
Preconference paper. National Curriculum Conference 
28: 1686 

McKerlie, D. 

1979 E6tabtUhmnt a rmdia Iniomation and zvaluxUlon 6tj6tm 
Sydney: Department of Technical and Further Education, New South Wales 
23: 1360 

Marsh, C. J. oX aZ. 

1981 SoZzctton and dJj>tnlbvution cuA/Uculum matoJuaZ^ 
Perth: Education Department of Western Australia 
2^: 1228 

2. Bilingual-bicultural and multicultural education, and related areas 
Seddon, T. 

1983 The politics of content selection: the case of Japanese history 
textbooks 

In: Hutchins 3. 2^ aZ. (eds.). Shaping thz caAJUculm, 1, 18.1-18.4 
Adelaide: South Australian College of Advanced Education 
Preconference paper. National Curriculum Conference 
12: 1750 

Watt, M. 

1984 A giUdz ion, Ji^dlzcXlng bltinguaZ blcuZtuAjoZ h.q^ouacz matoAAJxt^^ 
volmz 1 

Hobart: University of Tasmania 
28: 1785 

Watt, M. 

1984 A gtu.de ioH. 6QJizctlng blllnguaZ blcaltunaZ kz^oixacz matoAlaZ^, 
voZmz 2 

Hobart: University of Tasmania 
28: 1786 

Watt, M. and De Jong, M. 

1984 A gtUdz ion, ^oZzcting blZingaaZ blcultuAjoZ xq^ouacz matoAyLaLs, 
voZmz 3 

Hobart: University of Tasmania 
28: 1787 
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APPENDIX 6: BIBLIOGRAPHY OF JOURNAL ARTICLES IN 'AU5TRALIAW EVUCATION WVEK 
The Australian Council for Educational Research, Hawthorn, Victoria 3122, 
Australia 

1 General 

1.1 Methodologies 

Chan, K. P. 

1983 Evaluating a textbook to suit our local environment 
EduccuUon Llb/ioAy Sdnvlcz EuJildtin^ 21: 2, 21-24 
26: 3190 

Crewe, »]. 

1981 Selecting curriculum materials K-12 
Ofiana, 17: 4, 153-157 
25: 1397 

Gunter, A. 

1979 Choosing and organising learning materials 
Study 0^ SocieXy^ K): 2, 4-5 
23: 1329 

Gunter, A. 

1979 Mixed ability classes: choosing and organising learning materials 
kiUitAJxZyian JouAnaZ Rmzdlat EduacutLon^ 11: 3, 18-26 
23: 1330 

Gunter, A. 

1983 Guidelines for choosing books and course materials 
EnQtuh In kiii>tnjaLiay 65, 3-8 

27: 1467 

Krister, L* 

1984 Evaluating instructional packages 
AiUt/tatlan JouAnoZ AduZt EduacutLon^ 24: 1, 11-17 
28: 1876 

Marsh, C. 

1983 Primary school principals: intentions and realities in the 
selection of curriculum materials 

AiUiiAaLLan AdmlyiutAcuto/i y 4: 3, 1-4 
27: 1505 

Vancouver School Board. Board of School Trustees of School District 39 

1984 Selection of learning resources: a policy statement 

JouAnaZ 0^ thz School LlbnjOJiy A^^oclcutton o^ QixzzYU^^land ^ 16: 3, 15-18 
28: 3938 

1.2 Studies 
Langrehr, J. 

1983 Case studies: how do you select curriculum materials? 
CuAJUciitm ?QAMpz(iti\)QJi^ 3: 1, 31-36 
27: 1492 
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2 Teacher education 
2.1 Studies 

Gough, N. 

1983 Curriculum development and teacher development in a materials 
evaluation project 

CuAAlcLitum PeA4pec;tcf , 3: 1, 37-43 
27: 1634 

3 Bilingual-bicultural and multicultural education, and related areas 
3.1 Methodologies 

Borthwick, J. 

1982 The selection of textbooks: source books and course books for the 

English classroom 

EngtUh in KvUiViaJUay 51, 3-21 

27: 1427 

Brimble, R. A. 

1981 A guide to selecting reading materials 
ka^iAoLLciYi JoLUinaZ RzacUng, 4: 4, 173-178 
25: 1620 

Comber, B. 

1981 Self selecting and reading with purpose 
Rzading AKound^ 9: 4, 91-94 
25: 1640 

Davey, G. 

1979 Non-English literature and folklore for young children: some 

problems in selection of material 

Au^tAotLan JouAnal EcxAZy CkiZdhood, 4: 4, 9-12 

23: 1540 

Hyland, L. 

1979 Selecting fiction books for aboriginal children 
l/AT, 4: 12, 22-23 
23: 1340 



Hyland, L. 

1980 Selecting fiction for aboriginal children 
Polycom, 25, 24-27 

25: 1427 

Smith, J. 

1981 Selecting literary texts in the multicultural classroom: some 
considerations 

TddchlnQ oi EngLuky 41, 3-13 
26: 2264 

van Wageningen, B. 

1985 Prejudice in writing: analysing texts for bias 
MiiUlcuZtuAjCit Education Hm^^loJXdn,^ 35, 3-6 
28: 1778 
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3.2 Studies 



Brimble, R. A. 

1981 Who selects reading materials? 
Avu,tMaLLan Journal 0(5 Rzading^ 4: 4, 199-202 
25: 1621 

Lippman, L. 

1983 Survey of racial and ethnic bias in primary text books 
WlkoAu, 12, 107-123 
27: 1495 

Marsh, C. J. et al . 

1985 Teachers' perceptions about selection, distribution and use 
social studies and mathematics curriculum materials v/ithin a state 
education system 

JouJinaJt oi CuMvicahm StacUzi, 17: 1, 49-61 
28: 2599 
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APPENDIX 7: 



EIXTRACT FPOM TEE INTRDDOCTORY LETTER TO THE SURVEY 



It is intended that the content of such a course would include the 
following aspects: 

1. Rationale: The purpose of the program is to inprove the 
quality of selection and evalu^':tion of curriculum materials* 

2. Objectives: The objectives of the program are: 

2.1 to transmit knowledge concerning different types of 
organizations and methods for selecting and evaluating 
curriculum materials; 

2.2 to allow participants to experience these processes 
through conducting actual selections and evaluations of 
apprcpriate curriculum materials? 

2.3 to transmit knowledge concerning presently available 
resources for selecting and evaluating curriculum 
materials; and 

2.4 to define problems inherent in curriculum materials 
generally. 

3. Ccxitents: The contents of the program are not intended to be 
treated as mutually exclusive segments or sequentially. For 
convenience, the contents are presented respectively as: 

3.1 

3.1.1 the pre;; -^tion of knowledge about alternative 
organiiw nal structures for selecting 
curriculum materials (ranging from selection by 
individual selectors to selection by cotiwiittee 
either inside or outside the educational 
context) ; 

3.1.2 alternative methods for selecting curriculum 
materials (ranging from use of undefined 
criteria and standards to appraisal forms 
applying coninonly agreed-upon criteria and 
standards ) ; 

3.1.3 alternative organizations for evaluating 
curriculum materials (ranging frcm individual 
evaluatorsr individual evaluators and editors to 
an evaluation team operating inside or outside 
the educational context); and 

3.1.4 alternative methods for evaluating curriculum 
materials (ranging from literary criticism to 
evaluation instruments based upon explicitly 
defined or optional curriculum models). 

3.2 provision of scope for participants to experience the ranges 
of alternatives in organizations and methods through 
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conducting selections and evaluations of curriculum 
naterialSf and to form values concerning the apprqpriateness 
of each; 

3.3 to present knowledge about institutions and publications 
currently available concerning the selection and evaluation 
of curriculum materials; 

and 

3.4 the presentation of kna>/ledge about prc±)lems inherent in 
curriculum materials generally - the characteristics of 
quality (the lack of comprehensive criteria) ^ the conduct of 
research in curriculum materials to provide needed answers 
(the inadequacy of the experimental model of research to 
adequately investigate the problems of curriculum materials 
particularly those concerned with inparting values )f the 
incorporation of learner based verification and revision (its 
applicability to different types of learning materials^ 
conpilation of such data including valid and reliable field 
testing procedures) ^ and the need to define responsibility 
for learning resulting from curriculum materials. 

Methods: Didactic instruction ^ discussion and questioning 
methods would be ajprqpriate for presenting the contents of 
3. If 3.2f 3.3 and scxtie aspects of 3.4. Problem-solving ^ 
heuristic and discovery methods f role-playing and simulation f 
and ejqperiential methods would be appropriate for presenting 
the contents of 3.2 and some aspects of 3.4. 

Means of Assessment: Assessment is designed to be applied in 
two contexts. 

(i) Assessment within the program: This would involve the 
development of criterion-referenced instruments such 
as performance-based checklists for both formative and 
summative assessment of participants through 
observation. 

(ii) Assessment within the educational context: 

Criterion-referenced instruments may also be developed 
for this purpose f or a clinical supervisory model may 
be applied. 
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APPENDIX 8 s THE RESULTS OP THE SURVEY OF COURSE CO-ORDINRTORS 
OP THE CEKTRE FOR COWTINUING EDUCATION OP TEACHERS 



1. lOroWLEDGE AND SKILLS 

1.1 Do you believe it is essential for teachers to possess 
knowledge and skills about how to select curriculum 
materials? 

yes, strongly agree 4 
yes, agree 2 
undecided 0 
no, disagree 0 
no, strongly disagree 0 



1.2 Please write below additional oonroents you wish to make about 
teachers possessing knowledge and skills to select and 
evaluate curriculum materials, particularly as this relates 
to teacher education. 

Ccninent 1: •! think that as most teachers have to make 

choices about curriculum materials, it is very 
iitportant that they have some idea of how to go 
about it.* 

Cosmient 2: 'I'd agree, and there is some value in making 
this task to "select and evaluate curriculum 
materials" a conscious one in all of us as 
teachers. I doubt the point of view that this 
task depends upon a single set of principles, 
and believe each curriculum area should address 
the task and examine the principles that apply 
in that area.* 



2. CHOICE OP COURSE EESIGN 

2.1 Which type of course design do you believe is most 
apprc^riate to learners* needs? 

an independently operating CCET course 0 

a topic incorporated within an existing subject 5 

some combination of both the above course designs 1 
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2.2 Please write below comments you wish to make about options that 
might be chosen to develop suitable course designs for staff 
development of teachers. 



Comment 1: 'You might wish to discuss with lecturers vrfiat 
they do already • It may lead to your offering 
advice to them - or it may point out the areas 
of the curriculum as yet unaddressed in CCET 
units wliere such a study as your proposed unit 
might concentrate its attention* ' 

Comment 2: 'The CCET Computers in Education course already 
contains a unit on the evaluation and selection 
of software and associated materials.' 



3. INEEPENEENTLY OPERfiTING CCET COURSE 

Hew well does the coverage provided within the course outline 
given in the introductory letter 



3.1 ...offer attention 
to knowledge? 



exc. good fair poor uncert.unsp3C. 



3.2 ...offer attention 
to skills? 



0 2 0 2 2 



3.3 ...offer attention 
to attitudes and 
values? 



0 



3.4 ...suitable for 

the needs of teachers? 



3.5 If you were asked to contribute to developnent and 

inplementation of this type of course design, to what extent 
would you support this? 



yeS/ strongly support 

yes, support 

undecided 

no, oppose 

no, strongly oppose 

not specified 



1 
1 
2 
1 
0 
1 



FRir 
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3.6 Please write below additional co!Tffnents about any aspect for 

including an independently operating general course in the CCET 
program. 



Cocment I: 'I think that an indepjendently operating 

general course would ju£>t preach to the already 
converted. Ajs I think a unit on this topic 
would be valuable for all teachers ^ I would 
support a unit in an already existing course.' 



Conment 2: 'I think there should be as wide a range of 
units available to teachers as possible, and 
they should bear directly on teaching concerns 
(which this proposed unit does). However I 
suspect it will becaite an attempt to create 
another "field of educational knowledge" 
isolated by its thecretical concerns from the 
subject disciplines it is attenpting to secure. 
Choice of materials is bast discussed by the 
maths f reading r socdal studies etc. people vrfio 
know their cjm field a?>c! materials.' 



Coninent 3: 'I am not really convinced of the need for a 
vjhole course devoted to this?" 



4 . TOPIC INCORPORATED VfTTfllN AN ESCESTING SDBJEJCT 



4.1 Do you presently provide a topic about selecting and evaluating 
curriculum materials within your course? 



yes 
no 



6 
0 
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within the CCET course for which you are responsible, would ... 



strongly agree uncertain disagree strongly not 
agree disagree applic 



4.2 ...you view it to 
be beneficial 
to incorporate 
a topic about 
selecting and 
evaluating 
curriculum 
materials? 



4.3 ...it be feasible 
to incorporate 
a topic about 
selecting and 
evaluating 
curriculum 
materials? 



4.4 ..vit be beneficial 
for teachers in 
your course if 
such a topic was 
included? 



4*5 If you were asked to contribute to development and 

implementation of a topic about selecting and evaluating 
cuirriculum materials within your course, to what extent would 
you support this? 



yes, strongly support 4 

yes, support 0 

undecided 0 

no, expose 1 

no, strongly oppose 0 

not applicable 1 



EKLC 
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4.6 Please write below additional comments about any aspect of 
selecting and evaluating curriculum materials within your 
course • 



Canment 1: 'As I already include sane seminars on this topic 
in ti\e courser I would like to see it done 
"prc^rly". As I have only informal ej^rtise in 
this area, I too vould benefit from knowing how 
to go about it.' 



Comtient 2: 'I feel that discussion with you would be the 

best initial move in any kind of development in 
selecting and evaluating curriculum materials. We 
could see where it might be possible to go from 
there . ' 
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APPENDIX 9: LIST OF COURSES DEVELOPED BY THE CENTRE FOR CONTINUING 
EDUCATION OF TEACHERS, TASMANIA, AUSTRALIA 



1. Foundation Studies 

Foundations of Teaching I, Foundations of Teaching II, Foundations of 
Teaching III 

2. Advanced Studies 

Art in Education, Asian Studies in Education, Bases of Educational Decision, 
Classroom Strategies in Social Science, Comparative Education, Computers in 
Education, Drama in Education, Early Childhood Education, English for Secondary 
eachers. Educational Media, Environmental Studies in Education, Geography 
in Education, Health, Physical Education and Recreation, Home Economics in 
Education, Introduction to the Sociology of Education, Introduction to 
Special Education, Introductory Studies to Community Education, Language 
and Education, Language Development and Multicultural Education, Literature 
for Children, Mathematics and Education, Music and Education, Psychology 
and the Teacher, Reading and Reading Development, Rural Science and Education, 
School and Classroom-based Curriculum Development, School Management and 
Education, Science and Education, Studies in Affective Education, Personal 
and Social Development, Studies in Craft Education, Studies in Numeracy, 
Studies in Student Welfare in Schools and Colleges, Studies in the Teaching 
of Religion, Testing and Assessment in the Classroom, and Topics in Science. 
An Education Project is also offered to provide for research requirements. 

3. Senior Staff Development Program 

Critical Skills in Educational Administration, Curriculum Management and 
Delivery, Curriculum Workshop, Evaluation and the. eacher, and an Education 
Project 
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